-- Logs begin at Mon 2022-05-09 19:37:08 UTC, end at Mon 2022-05-09 20:53:55 UTC. -- May 09 20:15:41.005097 dv-cinder-836996-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 20:15:41.014001 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 20:15:41 2022] *** May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: nodename: dv-cinder-836996-15-iscsi May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: machine: x86_64 May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: clock source: unix May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: pcre jit disabled May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: detected number of CPU cores: 4 May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: current working directory: / May 09 20:15:41.016014 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: detected binary path: /usr/bin/uwsgi-core May 09 20:15:41.016639 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: your processes number limit is 47680 May 09 20:15:41.016639 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: your memory page size is 4096 bytes May 09 20:15:41.016639 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: detected max file descriptor number: 2048 May 09 20:15:41.016639 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: lock engine: pthread robust mutexes May 09 20:15:41.016639 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: thunder lock: enabled May 09 20:15:41.016639 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 20:15:41.016639 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 20:15:41.061608 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: Python main interpreter initialized at 0x56521dc349c0 May 09 20:15:41.061608 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: python threads support enabled May 09 20:15:41.061608 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: your server socket listen backlog is limited to 100 connections May 09 20:15:41.061608 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: your mercy for graceful operations on workers is 90 seconds May 09 20:15:41.061947 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: mapped 403077 bytes (393 KB) for 2 cores May 09 20:15:41.062020 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: *** Operational MODE: preforking *** May 09 20:15:41.062271 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: *** uWSGI is running in multiple interpreter mode *** May 09 20:15:41.062271 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: spawned uWSGI master process (pid: 102508) May 09 20:15:41.062464 dv-cinder-836996-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 20:15:41.064565 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: spawned uWSGI worker 1 (pid: 102509, cores: 1) May 09 20:15:41.064565 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: spawned uWSGI worker 2 (pid: 102510, cores: 1) May 09 20:15:41.064565 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 20:15:42.261695 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 20:15:42.293886 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 20:15:43.000911 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:15:43.000911 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: from cryptography.utils import int_from_bytes May 09 20:15:43.001244 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:15:43.001244 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: from cryptography.utils import int_from_bytes May 09 20:15:43.032011 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:15:43.032011 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: from cryptography.utils import int_from_bytes May 09 20:15:43.032340 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:15:43.032340 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: from cryptography.utils import int_from_bytes May 09 20:15:45.644087 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 20:15:45.644602 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 20:15:45.644861 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 20:15:45.645230 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 20:15:45.645491 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 20:15:45.645892 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.646226 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.646556 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.646883 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.647220 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.647564 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.647894 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.648221 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.648556 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.648824 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.649146 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.649479 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-15-iscsi {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.649815 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.650127 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.650445 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.651356 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.651705 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.652039 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.652353 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.652856 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.652979 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 20:15:45.653353 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 20:15:45.653428 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.653606 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.653694 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 20:15:45.653923 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.654078 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 20:15:45.654268 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.654373 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 20:15:45.654588 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.654717 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.654903 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.655050 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.655251 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.655409 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.655587 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.655726 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.655922 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.656066 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.656239 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.656386 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.656643 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-15-iscsi {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.656739 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.656968 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.657055 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.657292 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.657389 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.657603 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.657705 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.657927 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.658015 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.658265 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-15-iscsi {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.658356 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.658597 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.658680 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.658914 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.659047 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.659235 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.659325 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.659579 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.659674 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.659892 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.660025 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.660225 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.660306 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.660540 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.660634 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.660861 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.661054 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.661155 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.661373 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.661508 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.661688 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.661787 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.662007 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.662103 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.662351 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.662441 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.662670 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.662759 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.662929 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.663020 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.663240 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.663328 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.663594 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.663681 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.663923 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.664014 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.664245 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.664339 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.664502 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.664647 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-15-iscsi {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.664761 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.664971 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.665086 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.665292 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.665413 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.665615 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.665726 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.666040 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.666135 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.666393 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.666678 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.666838 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.667348 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.667759 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.667855 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.668100 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.668192 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.668414 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.668497 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.668744 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.668844 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.669070 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.669161 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.669400 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.669491 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.669711 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.669804 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.670038 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.670123 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.670349 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.670432 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.670666 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.670759 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.670986 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.671075 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.671314 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.671422 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.671655 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.671741 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.671969 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.672059 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.672230 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.672321 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.672545 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.672633 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.672874 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.672960 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.673203 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.673292 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.673517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.673614 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.673779 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.673863 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.674039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.674159 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.674366 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.674470 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.674696 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.674796 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.675013 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.675109 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.675320 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.675435 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.675659 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.675742 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.675975 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.676066 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.676285 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.676375 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.676597 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.676681 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.676903 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.676988 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.677215 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.677297 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.677522 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.677616 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.677837 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.677921 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.678147 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.678235 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.678459 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.678543 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.678771 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.678864 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.679083 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.679172 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.679406 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.679493 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.679723 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.679808 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.680051 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.680199 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.680381 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.680486 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.680693 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.680785 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.681005 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.681105 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.681317 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.681425 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.681630 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.681746 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.681954 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.682068 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.682320 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.682636 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.682731 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.682964 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.683056 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.683277 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.683370 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.683617 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.683709 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.683943 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.684043 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.684258 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.684347 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.684568 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.684658 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.684893 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.684985 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.685200 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.685305 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.685513 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.685603 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.685831 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.685928 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.686142 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.686257 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.686449 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.686549 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.686759 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.686845 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.687067 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.687164 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.687376 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.687503 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.687709 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.687793 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.688018 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.688112 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.688328 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.688412 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.688633 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.688723 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.688949 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.689039 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.689275 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.689361 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.689586 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.689669 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.689899 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.689984 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.690210 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.690360 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.690519 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.690615 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.690834 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.690926 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.691165 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.691260 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.691502 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.691590 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.691822 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.691921 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.692154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.692245 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.692468 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.692566 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.692782 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.692879 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.693107 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.693190 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.693420 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.693503 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.693734 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.693824 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.694058 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.694142 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.694366 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.694462 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.694678 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.694763 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.695003 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.695095 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.695315 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.695445 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.695652 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.695737 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.695967 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.696051 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.696280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.696372 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.696591 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.696674 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.696902 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.696986 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.697212 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.697304 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.697523 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.698139 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.698391 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.698712 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.698857 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.699061 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.699202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.699427 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.699571 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.699750 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.699896 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.700080 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.700218 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.700409 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.700534 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.700726 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.700901 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:15:45.701044 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.701203 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.701367 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.701547 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.701693 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.701904 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.702036 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.702230 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.702353 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.702573 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.702665 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.702916 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.703001 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.703245 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.703336 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.703596 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.703692 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.703924 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.704019 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.704241 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.704382 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.704569 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.704652 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.704891 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.704976 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.705211 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.705303 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.705531 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.705627 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.705856 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.705947 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.706182 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.706266 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.706500 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.706594 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.706819 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.706909 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.707132 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.707215 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.707467 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.707569 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.707781 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.707875 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.708100 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.708183 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.708411 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.708506 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.708737 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.708828 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.709072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.709155 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.709387 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.709479 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.709727 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.709812 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.710041 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.710125 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.710359 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.710451 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.710678 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.710766 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.710994 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.711078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.711309 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.711435 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.711658 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.711752 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.711977 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.712068 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.712290 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.712381 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.712617 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.712715 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.712942 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.713051 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.713289 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.713901 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.714123 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.714545 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.714627 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.714863 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.714949 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.715189 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.715287 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.715542 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.715632 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.715863 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.715955 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.716189 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.716273 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.716506 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.716591 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.716836 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.716921 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.717156 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.717240 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.717474 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.717566 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.717790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.717872 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.718106 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.718198 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.718436 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.718579 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.718767 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.718900 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.719099 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.719222 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.719438 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.719567 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.719754 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.719899 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.720070 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.720238 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.720379 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.720555 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.720691 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.720896 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.721002 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.721213 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.721306 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.721536 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.721633 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.721855 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.721940 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.722175 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.722281 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.722487 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.722571 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.722795 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.722877 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.723112 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.723202 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.723445 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.723549 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.723758 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.723850 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.724069 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.724167 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.724379 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.724463 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.724704 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.724787 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.725017 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.725108 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.725330 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.725414 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.725652 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.725736 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.725969 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.726057 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.726288 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.726378 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.726607 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.726690 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.726924 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.727009 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.727239 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.727329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.727585 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.727685 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.727903 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.727988 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.728218 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.728313 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.728547 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.728632 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.728897 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.728989 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.729396 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.729480 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.729862 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.729958 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.730197 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.730280 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.730513 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.730595 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.730833 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.730928 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.731148 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.731232 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.731484 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.731629 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.731801 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.731903 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.732120 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.732260 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.732431 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.732522 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.732745 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.732837 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.733060 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.733144 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.733374 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.733519 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.733687 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.733774 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.734014 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.734096 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.734330 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.734413 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.734642 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.734733 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.734953 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.735074 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.735263 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.735346 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.735613 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.735706 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.735930 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.736015 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.736267 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.736352 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.736585 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.736679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.736911 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.736997 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.737223 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.737315 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.737544 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.737627 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.737868 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.737959 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.738186 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.738278 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.738504 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.738589 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.738821 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.738903 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.739136 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.739227 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.739479 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.739567 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.739800 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.739882 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.740114 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.740214 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.740428 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.740514 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.740739 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.740831 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.741054 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.741140 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.741373 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.741457 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.741682 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.741764 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.741995 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.742080 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.742304 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.742394 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.742622 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.742708 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.742939 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.743027 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.743249 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.743333 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.743586 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.743671 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.743902 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.743995 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.744228 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.744323 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.745081 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.745185 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.745460 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.745790 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.745886 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.746105 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.746284 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.746416 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.746624 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.746750 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.746948 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.747065 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.747277 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.747374 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.747622 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.747707 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.747956 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.748048 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.748276 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.748369 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.748603 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.748694 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.748913 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.748996 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.749236 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.749329 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.749563 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.749696 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.749883 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.749967 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.750203 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.750287 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.750519 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.750610 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.750838 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.750922 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.751153 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.751237 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.751494 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.751582 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.751811 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.751896 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.752119 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.752202 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.752429 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.752512 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.752743 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.752826 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.753060 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.753144 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.753374 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.753457 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.753692 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.753785 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.753999 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.754089 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.754315 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.754397 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.754626 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.754717 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.754937 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.755030 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.755248 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.755330 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.755594 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.755846 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.755933 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.756186 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.756270 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.756515 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.756600 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.756843 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.756930 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.757151 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.757233 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.757462 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.757554 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.757789 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.757875 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.758107 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.758198 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.758417 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.758509 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.758727 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.758824 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.759042 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.759125 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.759365 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.759466 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.759705 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.759800 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.760016 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.760665 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.760883 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.761205 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.761430 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.761523 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.762024 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.762114 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.762348 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.762440 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.762667 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.762759 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.762978 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.763069 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.763290 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.763374 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.763641 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.763776 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.763955 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.764048 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.764270 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.764367 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.764580 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.764665 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.764899 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.764991 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.765214 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.765307 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.765525 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.765608 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.765836 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.765919 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.766147 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.766239 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.766466 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.766550 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.766787 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.766876 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.767102 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.767196 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.767439 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.767528 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.767770 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.767855 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.768108 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.768341 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.768426 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.768684 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.768766 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.769008 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.769108 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.769330 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.769415 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.769640 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.769724 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.769955 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.770047 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.770271 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.770355 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.770580 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.770663 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.770897 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.770981 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.771214 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.771319 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.771568 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.771656 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.771886 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.771971 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.772195 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.772286 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.772511 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.772604 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.772821 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.772978 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.773137 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.773222 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.773451 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.773533 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.773759 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.773856 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.774066 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.774149 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.774379 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.774462 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.774690 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.774782 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.774996 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.775087 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.775312 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.775482 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.775647 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.775787 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.775998 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.776385 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.776491 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.776619 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.776778 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.776928 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.777118 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.777244 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.777441 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.777558 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.777759 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.777852 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.778076 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.778180 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.778391 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.778495 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.778740 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.778826 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.779057 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.779142 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.779415 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.779502 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.779730 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.779824 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.780039 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.780123 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.780354 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.780455 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.780678 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.780777 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.780999 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.781092 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.781308 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.781408 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.781618 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.781708 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.781925 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.782016 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.782233 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.782395 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.782542 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.782626 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.782848 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.782932 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.783152 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.783244 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.783489 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.783577 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.783801 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.783925 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.784111 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.784204 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.784418 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.784500 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.784735 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.784825 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.785047 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.785132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.785356 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.785439 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.785667 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.785750 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.785976 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.786060 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.786289 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.786372 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.786608 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.786691 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.786924 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.787009 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.787235 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.787319 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.787578 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.787675 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.787891 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.787975 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.788212 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.788295 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.788522 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.788613 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.788840 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.788923 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.789149 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.789238 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.789466 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.789559 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.789778 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.789860 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.790085 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.790168 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.790395 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.790492 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.790706 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.790790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.791025 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.791107 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.791360 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.791482 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.791726 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.792195 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.792287 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.792533 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.792626 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.792858 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.792951 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.793169 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.793252 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.793486 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.793578 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.793804 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.793888 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.794115 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.794206 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.794429 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.794524 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.794740 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.794829 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.795055 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.795144 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.795364 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.795519 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.795704 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.795799 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.796014 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.796105 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.796327 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.796412 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.796640 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.796723 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.796951 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.797035 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.797265 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.797357 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.797574 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.797657 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.797898 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.797988 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.798210 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.798295 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.798517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.798601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.798824 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.798915 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.799134 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.799217 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.799473 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.799562 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.799788 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.799885 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.800150 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.800232 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.800473 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.800556 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.800802 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.800894 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.801120 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.801202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.801435 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.801517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.801749 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.801840 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.802059 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.802148 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.802376 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.802503 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.802685 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.802782 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.803002 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.803091 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.803312 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.803437 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.803647 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.803733 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.803975 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.804059 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.804292 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.804375 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.804608 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.804695 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.804935 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.805017 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.805260 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.805344 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.805567 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.805651 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.805877 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.805969 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.806188 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.806278 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.806501 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.806591 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.806816 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.806899 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.807729 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.807856 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.808143 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.808366 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.808450 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.808694 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.808785 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.809012 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.809098 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.809381 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.809471 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.809700 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.809783 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.810012 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.810104 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.810328 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.810412 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.810643 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.810734 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.810955 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.811040 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.811286 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.811371 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.811628 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.811726 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.811940 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.812030 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.812256 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.812341 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.812567 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.812724 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.812884 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.812969 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.813196 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.813284 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.813505 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.813627 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.813837 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.813947 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.814167 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.814301 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.814487 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.814593 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.814816 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.814902 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.815162 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.815245 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.815520 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.815620 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.815845 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.815936 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.816156 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.816253 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.816516 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.816601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.816828 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.816911 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.817147 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.817237 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.817463 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.817548 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.817775 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.817872 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.818082 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.818174 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.818399 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.818483 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.818709 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.818801 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.819027 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.819111 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.819342 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.819473 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.819678 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.819765 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.819986 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.820077 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.820299 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.820390 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.820627 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.820749 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.820934 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.821063 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.821263 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.821363 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.821585 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.821676 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.821917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.822081 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.822262 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.822400 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.822582 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.822963 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.823176 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.823372 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.823549 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.823714 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.823887 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.824011 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.824224 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.824346 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.824544 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.824660 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.824868 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.824974 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.825188 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.825302 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.825522 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.825639 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.825855 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.825975 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.826174 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.826293 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.826496 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.826634 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.826821 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.826964 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.827154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.827293 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.827511 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.827643 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.827837 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.827975 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.828168 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.828286 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.828590 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.828682 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.828905 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.828988 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.829215 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.829317 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.829526 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.829618 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.829881 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.829972 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.830150 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.830245 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.830457 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.830541 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.830768 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.830851 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.831077 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.831169 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.831434 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.831522 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.831725 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.831809 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.832037 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.832122 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.832355 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.832445 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.832665 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.832749 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.832977 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.833069 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.833284 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.833369 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.833597 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.833680 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.833926 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.834010 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.834234 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.834316 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.834562 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.834663 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.834883 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.834975 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.835209 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.835308 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.835547 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.835648 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.835863 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.835947 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.836186 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.836276 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.836501 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.836594 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.836815 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.836900 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.837127 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.837211 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.837438 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.837531 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.837758 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.837840 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.838077 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.838163 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.839018 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.839148 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.839530 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.839616 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.839863 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.839959 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.840189 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.840275 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.840570 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.840723 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.840907 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.841058 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.841608 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.841704 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.841783 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.841860 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.842000 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.842198 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.842319 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.842515 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.842639 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.842831 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.842964 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.843153 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.843259 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.843499 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.843589 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.843818 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.843905 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.844132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.844218 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.844449 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.844567 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.844760 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.844844 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.845071 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.845189 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.845383 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.845514 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.845713 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.845838 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.846026 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.846147 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.846355 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.846468 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.846673 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.846831 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.846987 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.847151 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.847383 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.847525 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.847722 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.847821 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.848074 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.848159 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.848389 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.848473 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.848726 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.848817 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.849044 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.849129 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.849365 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.849449 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.849687 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.849794 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.850004 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.850088 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.850317 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.850401 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.850636 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.850722 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.850958 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.851047 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.851281 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.851365 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.851631 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.851719 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.851954 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.852046 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.852274 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.852371 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.852595 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.852680 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.852911 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.853034 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.853236 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.853437 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.853559 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.853760 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.854038 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.854226 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.854700 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.855018 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.855105 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.855351 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.855455 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.855728 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.855824 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.856060 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.856152 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.856389 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.856475 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.856700 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.856796 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.857017 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.857101 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.857333 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.857424 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.857654 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.857746 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.857978 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.858076 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.858296 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.858388 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.858609 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.858704 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.858937 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.859028 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.859253 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.859339 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.859626 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.859822 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.859959 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.860176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.860287 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.860503 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.860595 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.860838 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.860922 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.861173 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.861277 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.861497 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.861604 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.861812 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.861924 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.862142 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.862250 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.862457 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.862574 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.862770 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.862898 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.863092 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.863218 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.863442 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.863570 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.863744 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.863895 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.864055 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.864220 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.864372 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.864541 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.864687 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.864860 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.864997 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.865181 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.865314 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.865504 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.865624 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.865837 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.865956 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.866182 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.866276 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.866514 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.866598 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.866838 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.866950 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.867162 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.867248 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.867494 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.867592 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.867815 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.868034 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.868131 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.868357 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.868441 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.868699 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.868782 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.869028 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.869113 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.869345 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.869937 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.870262 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.870583 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.870675 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.870896 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.870980 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.871211 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.871294 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.871606 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.871714 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.871923 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.872019 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.872245 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.872328 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.872558 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.872651 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.872868 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.872960 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.873191 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.873274 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.873510 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.873594 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.873823 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.873914 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.874140 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.874230 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.874459 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.874543 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.874802 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.875001 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.875344 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.875453 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.875696 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.875781 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.876025 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.876108 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.876359 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.876496 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.876687 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.876779 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.876998 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.877089 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.877311 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.877412 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.877624 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.877715 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.877936 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.878063 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.878396 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.878506 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.878591 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.878679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.878872 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.878957 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.879180 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.879273 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.879517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.879619 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.879834 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.879920 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.880148 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.880242 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.880465 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.880558 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.880778 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.880862 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.881093 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.881180 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.881406 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.881489 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.881719 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.881803 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.882030 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.882116 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.882348 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.882440 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.882660 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.882745 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.882972 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.883058 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.883288 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.883372 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.883624 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.883726 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.883942 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.884034 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.884254 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.884340 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.884567 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.884658 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.884877 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.885007 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.885744 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.885862 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.886151 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.886475 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.886644 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.887040 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.887226 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.887491 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.887623 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.887817 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.887959 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.888148 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.888278 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.888477 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.888594 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.888795 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.888921 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.889124 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.889242 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.889452 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.889575 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.889771 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.889898 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.890097 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.890218 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.890413 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.890575 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.890748 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.890901 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.891103 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.891456 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.891554 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.891791 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.891883 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.892104 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.892189 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.892418 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.892516 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.892728 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.892813 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.893043 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.893136 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.893367 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.893460 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.893683 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.893767 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.893991 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.894075 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.894300 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.894393 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.894615 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.894699 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.894923 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.895007 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.895233 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.895319 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.895569 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.895662 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.895879 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.895963 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.896192 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.896280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.896502 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.896594 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.896811 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.896898 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.897119 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.897205 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.897428 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.897512 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.897737 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.897835 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.898048 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.898132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.898369 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.898453 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.898678 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.898771 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.898990 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.899082 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.899299 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.899384 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.899637 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.899734 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.899946 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.900039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.900281 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.900364 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.900603 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.900713 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.901066 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.901406 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.901503 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.901724 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.901819 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.902053 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.902151 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.902372 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.902463 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.902700 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.902798 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.903030 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.903116 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.903354 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.903466 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.903698 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.903795 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.904039 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.904132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.904358 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.904442 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.904676 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.904762 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.904993 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.905079 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.905309 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.905393 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.905625 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.905710 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.905941 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.906025 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.906273 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.906357 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.906607 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.906692 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.906920 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.907004 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.907250 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.907343 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.907590 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.907675 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.907908 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.907993 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.908226 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.908371 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.908542 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.908634 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.908867 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.908959 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.909185 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.909282 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.909496 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.909580 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.909812 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.909902 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.910128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.910212 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.910445 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.910528 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.910760 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.910844 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.911074 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.911159 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.911388 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.911497 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.911725 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.911809 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.912039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.912126 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.912352 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.912436 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.912665 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.912749 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.912980 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.913076 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.913294 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.913378 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.913606 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.913709 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.913924 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.914008 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.914237 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.914321 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.914551 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.914645 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.914823 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 20:15:45.914906 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.915160 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.915500 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.915840 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.916180 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.917004 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.917349 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.917675 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.918011 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.918334 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.918670 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.919003 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.919333 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.919790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.920135 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.920459 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.920786 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.921106 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.921426 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.922065 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.922401 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.922736 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.923051 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.923384 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.923737 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.924070 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.924397 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.924718 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.925058 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.925378 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.925698 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.926035 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.926357 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.926678 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.927005 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.927341 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.927701 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.928035 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.928516 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.928861 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.929219 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.929544 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.929899 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.930235 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.930564 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.930886 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.931203 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:15:45.931483 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 20:15:45.938663 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_db.sqlalchemy.engines [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:45.956607 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_db.sqlalchemy.engines [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:46.002465 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.context [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),226b11f8-5e53-483b-be5e-f910c39e1ec6(cell1) {{(pid=102510) load_cells /opt/stack/nova/nova/context.py:464}} May 09 20:15:46.006799 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:15:46.008410 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:15:46.009207 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:15:46.012077 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:15:46.024174 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_db.sqlalchemy.engines [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:46.029141 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_db.sqlalchemy.engines [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:46.031686 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.context [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),226b11f8-5e53-483b-be5e-f910c39e1ec6(cell1) {{(pid=102509) load_cells /opt/stack/nova/nova/context.py:464}} May 09 20:15:46.036095 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_concurrency.lockutils [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:15:46.037738 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_concurrency.lockutils [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:15:46.038539 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_concurrency.lockutils [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:15:46.040521 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_concurrency.lockutils [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:15:46.053622 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_db.sqlalchemy.engines [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:46.058684 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_db.sqlalchemy.engines [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:46.188623 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_db.sqlalchemy.engines [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:46.222977 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG oslo_db.sqlalchemy.engines [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:15:46.528711 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: WARNING keystonemiddleware.auth_token [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:15:46.536088 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: WARNING keystonemiddleware.auth_token [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:15:46.555077 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: WARNING keystonemiddleware.auth_token [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:15:46.564338 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: WARNING keystonemiddleware.auth_token [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:15:46.880137 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: WARNING keystonemiddleware.auth_token [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:15:46.887071 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: WARNING keystonemiddleware.auth_token [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:15:46.893072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56521dc349c0 pid: 102510 (default app) May 09 20:15:46.895182 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:15:46.896441 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001848 May 09 20:15:46.896858 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Mon May 9 20:15:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:15:46.932455 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: WARNING keystonemiddleware.auth_token [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:15:46.938819 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: WARNING keystonemiddleware.auth_token [None req-03ed9ce2-8101-47ff-95cc-c9ef783466c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:15:46.944025 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56521dc349c0 pid: 102509 (default app) May 09 20:17:04.897482 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:04.898638 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 09 20:17:04.899036 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:05.323041 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-52c1fe4b-80f0-486d-8e22-4d5b29eabda8 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:05.353406 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-52c1fe4b-80f0-486d-8e22-4d5b29eabda8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447637 May 09 20:17:05.353869 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 20:17:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:17:07.647989 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:07.649072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-4e050235-e4d1-43ee-9c84-929f4fa8a46e None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 09 20:17:07.649476 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:07.713420 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-01c57fb2-5131-4b2a-bb40-e25187a28081 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:07.734612 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:17:07.734612 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: warnings.warn(msg) May 09 20:17:07.765028 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-01c57fb2-5131-4b2a-bb40-e25187a28081 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109648 May 09 20:17:07.765715 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:07.983821 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-6e3384e6-8f3d-4e93-902a-bee205301548 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:07.986145 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:17:07.986145 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: warnings.warn(msg) May 09 20:17:08.035661 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-6e3384e6-8f3d-4e93-902a-bee205301548 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261756 May 09 20:17:08.036629 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 20:17:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:17:10.320934 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-01c57fb2-5131-4b2a-bb40-e25187a28081 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:10.322718 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-01c57fb2-5131-4b2a-bb40-e25187a28081 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002722 May 09 20:17:10.323123 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:10.450065 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-e29c3cad-2957-4baf-8263-3d1c62d1dbd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:10.468626 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:17:10.468626 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: warnings.warn(msg) May 09 20:17:10.485397 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-e29c3cad-2957-4baf-8263-3d1c62d1dbd4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156450 May 09 20:17:10.485952 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 20:17:10.498092 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-3c71c932-aadd-405a-a644-9c9f21dfe804 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:10.499592 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:17:10.499592 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: warnings.warn(msg) May 09 20:17:10.530790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-3c71c932-aadd-405a-a644-9c9f21dfe804 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036212 May 09 20:17:10.531289 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 20:17:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:17:12.856193 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-e29c3cad-2957-4baf-8263-3d1c62d1dbd4 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:12.858085 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-e29c3cad-2957-4baf-8263-3d1c62d1dbd4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002782 May 09 20:17:12.858720 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:12.927637 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-acb175d6-cfe4-4fb2-b52e-344d4e4176da admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:12.948092 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-acb175d6-cfe4-4fb2-b52e-344d4e4176da admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083204 May 09 20:17:12.955310 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:12.960748 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-3ff14491-1f21-4e6a-b47d-962db17a85e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:12.986997 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-3ff14491-1f21-4e6a-b47d-962db17a85e0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030322 May 09 20:17:12.987937 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 20:17:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:17:15.279790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-acb175d6-cfe4-4fb2-b52e-344d4e4176da admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:15.280851 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-acb175d6-cfe4-4fb2-b52e-344d4e4176da admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 May 09 20:17:15.281264 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:15.342605 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-aba6fd39-1339-4cf5-be29-3bf7af8c33e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "ram": 2048, "swap": 0, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:15.363976 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-aba6fd39-1339-4cf5-be29-3bf7af8c33e7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076419 May 09 20:17:15.364548 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:15.377057 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-6c760782-959d-467f-b902-6259b1b3bf7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:15.402459 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-6c760782-959d-467f-b902-6259b1b3bf7e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029081 May 09 20:17:15.403057 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 20:17:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:17:17.708859 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-aba6fd39-1339-4cf5-be29-3bf7af8c33e7 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:17.711100 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-aba6fd39-1339-4cf5-be29-3bf7af8c33e7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 May 09 20:17:17.711792 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:17.769792 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-19eff657-5f23-4636-8d8d-db9affc48a2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:17.788431 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-19eff657-5f23-4636-8d8d-db9affc48a2e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070869 May 09 20:17:17.789201 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:17.801139 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-4d6c6ef9-ef70-4d43-8e47-92f7f3a0b313 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:17.824440 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-4d6c6ef9-ef70-4d43-8e47-92f7f3a0b313 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027185 May 09 20:17:17.825295 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 20:17:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:17:20.109462 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-19eff657-5f23-4636-8d8d-db9affc48a2e admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:20.110444 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-19eff657-5f23-4636-8d8d-db9affc48a2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 09 20:17:20.110912 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:20.174675 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-25a39923-b39f-4168-bc84-a950a43f63f1 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:20.199572 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-25a39923-b39f-4168-bc84-a950a43f63f1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081591 May 09 20:17:20.200241 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 20:17:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:17:22.495857 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-19eff657-5f23-4636-8d8d-db9affc48a2e admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:22.497243 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-19eff657-5f23-4636-8d8d-db9affc48a2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 May 09 20:17:22.497776 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:22.561658 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-beabcd5f-1121-4c2d-aed8-ad9685c93fa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "ram": 512, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:22.584313 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-beabcd5f-1121-4c2d-aed8-ad9685c93fa3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080449 May 09 20:17:22.584991 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:22.597660 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-db1dccb2-4571-46a0-b0ce-f6ca9d2af435 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:22.625357 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-db1dccb2-4571-46a0-b0ce-f6ca9d2af435 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031344 May 09 20:17:22.626109 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 20:17:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:17:24.870787 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-beabcd5f-1121-4c2d-aed8-ad9685c93fa3 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:24.872232 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-beabcd5f-1121-4c2d-aed8-ad9685c93fa3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 May 09 20:17:24.872728 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:24.937777 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-6cca4dfe-848f-4e3c-ac15-798da8b532f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:24.956403 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-6cca4dfe-848f-4e3c-ac15-798da8b532f9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076415 May 09 20:17:24.958696 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:24.974921 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-ea0fb31b-354c-4121-8c4a-2c75d690386c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:25.002663 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-ea0fb31b-354c-4121-8c4a-2c75d690386c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032828 May 09 20:17:25.003411 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 20:17:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:17:27.738248 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-6cca4dfe-848f-4e3c-ac15-798da8b532f9 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:27.739410 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-6cca4dfe-848f-4e3c-ac15-798da8b532f9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 May 09 20:17:27.739932 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:27.797092 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-0ca55690-645b-4eea-a7ac-9d04cfd75b85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:27.815347 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-0ca55690-645b-4eea-a7ac-9d04cfd75b85 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069055 May 09 20:17:27.815947 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:27.828291 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-422ae09f-d245-4e7c-886b-5a6726fc887c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:27.850908 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-422ae09f-d245-4e7c-886b-5a6726fc887c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026236 May 09 20:17:27.851436 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 20:17:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:17:30.168429 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-0ca55690-645b-4eea-a7ac-9d04cfd75b85 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:30.169325 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-0ca55690-645b-4eea-a7ac-9d04cfd75b85 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 09 20:17:30.169734 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:30.227810 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-aab9f62d-5306-4e7a-a998-2f9a0242642f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "swap": 0, "ram": 8192}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:30.245931 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-aab9f62d-5306-4e7a-a998-2f9a0242642f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070213 May 09 20:17:30.246638 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:30.259684 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-30ca2df0-9f89-4a7a-8504-adf07f255f57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:30.282270 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-30ca2df0-9f89-4a7a-8504-adf07f255f57 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027357 May 09 20:17:30.282847 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 20:17:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:17:32.597382 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-aab9f62d-5306-4e7a-a998-2f9a0242642f admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:32.598402 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-aab9f62d-5306-4e7a-a998-2f9a0242642f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 09 20:17:32.598807 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:32.665179 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-02f3ad1f-86c3-42f8-892d-c7d3c4d8dfb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:32.684677 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-02f3ad1f-86c3-42f8-892d-c7d3c4d8dfb1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078543 May 09 20:17:32.685723 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 20:17:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:17:32.697199 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-8a07b8c7-2e49-45aa-ab61-4f601c6e62d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:17:32.724092 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-8a07b8c7-2e49-45aa-ab61-4f601c6e62d0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030616 May 09 20:17:32.724686 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 20:17:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:17:56.688704 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-02f3ad1f-86c3-42f8-892d-c7d3c4d8dfb1 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:56.689746 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-02f3ad1f-86c3-42f8-892d-c7d3c4d8dfb1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 09 20:17:56.690174 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:56.746214 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-28a6378c-cb2e-4b6c-a787-531086aa8ce7 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:56.764661 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-28a6378c-cb2e-4b6c-a787-531086aa8ce7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068405 May 09 20:17:56.765197 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 20:17:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:17:57.772667 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-02f3ad1f-86c3-42f8-892d-c7d3c4d8dfb1 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:57.773670 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-02f3ad1f-86c3-42f8-892d-c7d3c4d8dfb1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 May 09 20:17:57.774074 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:57.965469 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-1b20add1-fad0-4e08-9f77-80557c743175 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:57.970913 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.wsgi [None req-1b20add1-fad0-4e08-9f77-80557c743175 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-1b20add1-fad0-4e08-9f77-80557c743175 admin admin] Request method failure captured: May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Accept: application/json May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Accept-Encoding: gzip, deflate May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Connection: keep-alive May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Content-Length: 0 May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Host: 10.222.0.44 May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Openstack-Api-Version: compute 2.90 May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Openstack-System-Scope: None May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: User-Agent: python-novaclient May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Auth-Token: gAAAAABieXb1bdmru6XD6V3q6YY59fdVbSFWvAxhPRkTv9pBLIUIL3QzlLJUeGgeHOY-d3wMKDXe-Lbw8n8F91mNg8NvmjsF3nEkKgR4KikSKSveV_qI--Z3YIamA0hV3j_EBOTVPp1IWCVQGjva08DuJ6k3tY66LKPfRz47JGtDzHTW_ymLXpQ May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Domain-Id: None May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Domain-Name: None May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Identity-Status: Confirmed May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Is-Admin-Project: True May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Openstack-Nova-Api-Version: 2.90 May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Domain-Id: default May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Domain-Name: Default May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Name: admin May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Role: reader,member,admin May 09 20:17:57.974154 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Roles: reader,member,admin May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fc21a92582474562a4faafd37e72b6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fc21a92582474562a4faafd37e72b6be"}]}] May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant: admin May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant-Name: admin May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User: admin May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Domain-Id: default May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Domain-Name: Default May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Id: eda0196f36b948c2b847c376ca98040d May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Name: admin May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: method: > May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: exception: Flavor 42 could not be found. May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: action_args: {'id': '42'} May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:17:57.975679 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:57.976601 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:57.978039 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-1b20add1-fad0-4e08-9f77-80557c743175 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:17:57.979305 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-1b20add1-fad0-4e08-9f77-80557c743175 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061100 May 09 20:17:57.979305 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 20:17:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 09 20:17:57.985442 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-2bc77162-2915-4767-b419-889a7fff962f admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:58.008383 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-2bc77162-2915-4767-b419-889a7fff962f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026575 May 09 20:17:58.008940 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 20:17:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:17:58.018667 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-cb1dc678-d67f-4593-bdb1-d8d8e38c3b1a admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:58.039509 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-cb1dc678-d67f-4593-bdb1-d8d8e38c3b1a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024335 May 09 20:17:58.040044 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 20:17:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:17:58.049215 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-09258846-d752-4189-9791-4d97c12a13c2 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:58.055263 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.wsgi [None req-09258846-d752-4189-9791-4d97c12a13c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-09258846-d752-4189-9791-4d97c12a13c2 admin admin] Request method failure captured: May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Accept: application/json May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Accept-Encoding: gzip, deflate May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Connection: keep-alive May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Content-Length: 0 May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Host: 10.222.0.44 May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Openstack-Api-Version: compute 2.90 May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Openstack-System-Scope: None May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: User-Agent: python-novaclient May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Auth-Token: gAAAAABieXb1bdmru6XD6V3q6YY59fdVbSFWvAxhPRkTv9pBLIUIL3QzlLJUeGgeHOY-d3wMKDXe-Lbw8n8F91mNg8NvmjsF3nEkKgR4KikSKSveV_qI--Z3YIamA0hV3j_EBOTVPp1IWCVQGjva08DuJ6k3tY66LKPfRz47JGtDzHTW_ymLXpQ May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Domain-Id: None May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Domain-Name: None May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Identity-Status: Confirmed May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Is-Admin-Project: True May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Openstack-Nova-Api-Version: 2.90 May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Domain-Id: default May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Domain-Name: Default May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Name: admin May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Role: reader,member,admin May 09 20:17:58.058532 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Roles: reader,member,admin May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fc21a92582474562a4faafd37e72b6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fc21a92582474562a4faafd37e72b6be"}]}] May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant: admin May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant-Name: admin May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User: admin May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Domain-Id: default May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Domain-Name: Default May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Id: eda0196f36b948c2b847c376ca98040d May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Name: admin May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: method: > May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: exception: Flavor 42 could not be found. May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: action_args: {'id': '42'} May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:17:58.060078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:58.060961 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:58.061983 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-09258846-d752-4189-9791-4d97c12a13c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:17:58.062957 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-09258846-d752-4189-9791-4d97c12a13c2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014271 May 09 20:17:58.062957 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 20:17:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 20:17:58.951482 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-cb1dc678-d67f-4593-bdb1-d8d8e38c3b1a admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:58.952494 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-cb1dc678-d67f-4593-bdb1-d8d8e38c3b1a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 09 20:17:58.952897 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:17:59.138786 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-491a217f-efe3-4e75-827c-b2756eb0d8b5 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:59.144019 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.wsgi [None req-491a217f-efe3-4e75-827c-b2756eb0d8b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-491a217f-efe3-4e75-827c-b2756eb0d8b5 admin admin] Request method failure captured: May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Accept: application/json May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Accept-Encoding: gzip, deflate May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Connection: keep-alive May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Content-Length: 0 May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Host: 10.222.0.44 May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Openstack-Api-Version: compute 2.90 May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Openstack-System-Scope: None May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: User-Agent: python-novaclient May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Auth-Token: gAAAAABieXb203GuxYAuRq0DyS1ZuL8bZIMdaEgzcKOzTzjbDEJDoYky9scAliXaG4tThLV5Rd594Ahk7MbLrDoK3G_codrWxj6wi_vFJ_gk75JgfXEZCOz99ci6hhd6ifonVZQop9PKHBK6XIEjE916zIgemBpJaHz9I98E6gpdsBZ-beLOAh0 May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Domain-Id: None May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Domain-Name: None May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Identity-Status: Confirmed May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Is-Admin-Project: True May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Openstack-Nova-Api-Version: 2.90 May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Domain-Id: default May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Domain-Name: Default May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Name: admin May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Role: reader,member,admin May 09 20:17:59.145517 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Roles: reader,member,admin May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fc21a92582474562a4faafd37e72b6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fc21a92582474562a4faafd37e72b6be"}]}] May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant: admin May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant-Name: admin May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User: admin May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Domain-Id: default May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Domain-Name: Default May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Id: eda0196f36b948c2b847c376ca98040d May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Name: admin May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: method: > May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: exception: Flavor 84 could not be found. May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: action_args: {'id': '84'} May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:17:59.147072 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:59.148128 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:17:59.149176 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-491a217f-efe3-4e75-827c-b2756eb0d8b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:17:59.150188 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-491a217f-efe3-4e75-827c-b2756eb0d8b5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059621 May 09 20:17:59.150188 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 20:17:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 20:17:59.156898 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-ac360fbe-dc1f-4581-a37e-1148bbe6cd0c admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:59.170735 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-ac360fbe-dc1f-4581-a37e-1148bbe6cd0c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017464 May 09 20:17:59.171205 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 20:17:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:17:59.180867 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-3fae7523-3256-4523-96c5-79f26302f8a4 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:59.194386 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-3fae7523-3256-4523-96c5-79f26302f8a4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017397 May 09 20:17:59.194914 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 20:17:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:17:59.203872 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-b1c473fb-4fc3-4297-bfd3-aaaffe1eabef admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:17:59.209078 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.wsgi [None req-b1c473fb-4fc3-4297-bfd3-aaaffe1eabef admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-b1c473fb-4fc3-4297-bfd3-aaaffe1eabef admin admin] Request method failure captured: May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Accept: application/json May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Accept-Encoding: gzip, deflate May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Connection: keep-alive May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Content-Length: 0 May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Host: 10.222.0.44 May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Openstack-Api-Version: compute 2.90 May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Openstack-System-Scope: None May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: User-Agent: python-novaclient May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Auth-Token: gAAAAABieXb203GuxYAuRq0DyS1ZuL8bZIMdaEgzcKOzTzjbDEJDoYky9scAliXaG4tThLV5Rd594Ahk7MbLrDoK3G_codrWxj6wi_vFJ_gk75JgfXEZCOz99ci6hhd6ifonVZQop9PKHBK6XIEjE916zIgemBpJaHz9I98E6gpdsBZ-beLOAh0 May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Domain-Id: None May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Domain-Name: None May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Identity-Status: Confirmed May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Is-Admin-Project: True May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Openstack-Nova-Api-Version: 2.90 May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Domain-Id: default May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Domain-Name: Default May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Name: admin May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Role: reader,member,admin May 09 20:17:59.210732 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Roles: reader,member,admin May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fc21a92582474562a4faafd37e72b6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fc21a92582474562a4faafd37e72b6be"}]}] May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant: admin May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant-Id: fc21a92582474562a4faafd37e72b6be May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant-Name: admin May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User: admin May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Domain-Id: default May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Domain-Name: Default May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Id: eda0196f36b948c2b847c376ca98040d May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Name: admin May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: method: > May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: exception: Flavor 84 could not be found. May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: action_args: {'id': '84'} May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:17:59.212280 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:59.213132 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:17:59.214202 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-b1c473fb-4fc3-4297-bfd3-aaaffe1eabef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:17:59.215234 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-b1c473fb-4fc3-4297-bfd3-aaaffe1eabef admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011698 May 09 20:17:59.215234 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 20:17:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 20:18:00.098199 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-3fae7523-3256-4523-96c5-79f26302f8a4 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:00.099205 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-3fae7523-3256-4523-96c5-79f26302f8a4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 09 20:18:00.099645 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:18:00.288225 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-d93ff664-07c0-4d6c-a29c-9d9dc5bf7980 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:00.293836 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.wsgi [None req-d93ff664-07c0-4d6c-a29c-9d9dc5bf7980 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-d93ff664-07c0-4d6c-a29c-9d9dc5bf7980 admin admin] Request method failure captured: May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Accept: application/json May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Accept-Encoding: gzip, deflate May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Connection: keep-alive May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Content-Length: 0 May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Host: 10.222.0.44 May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Openstack-Api-Version: compute 2.90 May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Openstack-System-Scope: None May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: User-Agent: python-novaclient May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Auth-Token: gAAAAABieXb4RP-tFe3NaXSXNn6aetCgrtfwaVTeTO7Sh3q1EanFdugfakQxWBj7C2oh5XxnUj4ZoFLD5lWqjeRrkuLeUAsgsDg_mae6P1CgrimgdewnKOJAgrHlBexBr3k0KPDaHaDwse4HzVmVx7pySP0B2LpagsqK7Bl0RqqucQUMKRxGlTU May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Domain-Id: None May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Domain-Name: None May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Identity-Status: Confirmed May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Is-Admin-Project: True May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Openstack-Nova-Api-Version: 2.90 May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Domain-Id: default May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Domain-Name: Default May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Id: fc21a92582474562a4faafd37e72b6be May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Project-Name: admin May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Role: reader,member,admin May 09 20:18:00.295329 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Roles: reader,member,admin May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fc21a92582474562a4faafd37e72b6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fc21a92582474562a4faafd37e72b6be"}]}] May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant: admin May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant-Id: fc21a92582474562a4faafd37e72b6be May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-Tenant-Name: admin May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User: admin May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Domain-Id: default May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Domain-Name: Default May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Id: eda0196f36b948c2b847c376ca98040d May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: X-User-Name: admin May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: method: > May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: exception: Flavor 451 could not be found. May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: action_args: {'id': '451'} May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:18:00.296964 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:18:00.297790 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: ERROR nova.api.openstack.wsgi May 09 20:18:00.298827 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-d93ff664-07c0-4d6c-a29c-9d9dc5bf7980 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:18:00.299906 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-d93ff664-07c0-4d6c-a29c-9d9dc5bf7980 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059432 May 09 20:18:00.299906 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 20:18:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 20:18:00.306581 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-d5334ea2-3d45-4894-ba25-1bbfaec50ba6 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:00.319903 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-d5334ea2-3d45-4894-ba25-1bbfaec50ba6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016819 May 09 20:18:00.320355 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 20:18:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:18:00.329485 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:00.343619 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017583 May 09 20:18:00.344149 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 20:18:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:18:00.353838 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-4ae77d97-1437-47ca-b514-a096e7284a82 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:00.358949 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.wsgi [None req-4ae77d97-1437-47ca-b514-a096e7284a82 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-4ae77d97-1437-47ca-b514-a096e7284a82 admin admin] Request method failure captured: May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Accept: application/json May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Accept-Encoding: gzip, deflate May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Connection: keep-alive May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Content-Length: 0 May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Host: 10.222.0.44 May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Openstack-Api-Version: compute 2.90 May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Openstack-System-Scope: None May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: User-Agent: python-novaclient May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Auth-Token: gAAAAABieXb4RP-tFe3NaXSXNn6aetCgrtfwaVTeTO7Sh3q1EanFdugfakQxWBj7C2oh5XxnUj4ZoFLD5lWqjeRrkuLeUAsgsDg_mae6P1CgrimgdewnKOJAgrHlBexBr3k0KPDaHaDwse4HzVmVx7pySP0B2LpagsqK7Bl0RqqucQUMKRxGlTU May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Domain-Id: None May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Domain-Name: None May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Identity-Status: Confirmed May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Is-Admin-Project: True May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Openstack-Nova-Api-Version: 2.90 May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Domain-Id: default May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Domain-Name: Default May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Id: fc21a92582474562a4faafd37e72b6be May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Project-Name: admin May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Role: reader,member,admin May 09 20:18:00.360453 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Roles: reader,member,admin May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fc21a92582474562a4faafd37e72b6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fc21a92582474562a4faafd37e72b6be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fc21a92582474562a4faafd37e72b6be"}]}] May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant: admin May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant-Id: fc21a92582474562a4faafd37e72b6be May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-Tenant-Name: admin May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User: admin May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Domain-Id: default May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Domain-Name: Default May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Id: eda0196f36b948c2b847c376ca98040d May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: X-User-Name: admin May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: method: > May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: exception: Flavor 451 could not be found. May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: action_args: {'id': '451'} May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:18:00.361917 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:18:00.362908 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: ERROR nova.api.openstack.wsgi May 09 20:18:00.364403 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-4ae77d97-1437-47ca-b514-a096e7284a82 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:18:00.365600 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-4ae77d97-1437-47ca-b514-a096e7284a82 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012121 May 09 20:18:00.365600 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 20:18:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 09 20:18:01.255210 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:01.256257 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 09 20:18:01.256665 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:18:01.448150 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-bab852d7-ef35-475b-ad2d-225540143d92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:18:01.465769 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-bab852d7-ef35-475b-ad2d-225540143d92 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069369 May 09 20:18:01.466252 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 20:18:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:18:02.349409 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:02.351103 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 May 09 20:18:02.351528 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:18:02.538886 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-b1a14494-8e2a-4dc1-b867-f5640149cccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:18:02.556506 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-b1a14494-8e2a-4dc1-b867-f5640149cccf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068715 May 09 20:18:02.557048 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 20:18:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:18:03.465104 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:03.466146 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 09 20:18:03.466555 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:18:03.652084 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-db58aded-3202-4912-980b-f5ed8d98b715 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:18:03.669285 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-db58aded-3202-4912-980b-f5ed8d98b715 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067104 May 09 20:18:03.669823 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 20:18:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:18:04.556889 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:04.557929 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 09 20:18:04.558350 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:18:04.744412 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-6437a681-028f-4b43-9b8e-4f37cd77d593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:18:04.761632 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-6437a681-028f-4b43-9b8e-4f37cd77d593 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067867 May 09 20:18:04.762420 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 20:18:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:18:05.650560 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:05.651614 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 09 20:18:05.652013 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:18:05.837265 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-e5295f85-824d-41c7-8f52-cdf36975a4ef admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:18:05.856942 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-e5295f85-824d-41c7-8f52-cdf36975a4ef admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070183 May 09 20:18:05.857486 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Mon May 9 20:18:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:19:07.646281 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:19:07.647297 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-4bd16ff5-745d-4228-814d-82b63492bd75 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 09 20:19:07.647762 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 20:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:19:07.708910 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-360f608e-78c2-4205-8929-edf7fba76f80 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:19:07.727412 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-360f608e-78c2-4205-8929-edf7fba76f80 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073844 May 09 20:19:07.727940 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 20:19:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:19:07.751423 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-c7529d37-d8f4-4292-9e4e-752d7824c678 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:19:07.759808 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-c7529d37-d8f4-4292-9e4e-752d7824c678 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012808 May 09 20:19:07.760340 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Mon May 9 20:19:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:19:07.771932 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-53586d73-aa30-4690-ae7d-fe6c44224480 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:19:07.779529 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-53586d73-aa30-4690-ae7d-fe6c44224480 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011336 May 09 20:19:07.780044 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Mon May 9 20:19:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:19:07.791581 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:19:07.799086 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010991 May 09 20:19:07.799667 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Mon May 9 20:19:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:19:07.810967 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-e7d927b8-f6c5-4244-9e85-002416c0906e admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:19:07.819106 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-e7d927b8-f6c5-4244-9e85-002416c0906e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011582 May 09 20:19:07.819662 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Mon May 9 20:19:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:22:24.335748 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:24.336761 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 09 20:22:24.337166 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:22:24.603531 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-708080cb-bb7d-40b2-9e73-332f11a65a05 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:24.604699 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:22:24.604699 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: warnings.warn(msg) May 09 20:22:24.605875 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-708080cb-bb7d-40b2-9e73-332f11a65a05 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:24.606306 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-708080cb-bb7d-40b2-9e73-332f11a65a05 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:24.607078 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-708080cb-bb7d-40b2-9e73-332f11a65a05 admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:24.607524 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-708080cb-bb7d-40b2-9e73-332f11a65a05 admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:24.641202 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-708080cb-bb7d-40b2-9e73-332f11a65a05 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.149948 May 09 20:22:24.641756 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 20:22:24 2022] GET /compute/v2.1/os-services => generated 794 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:22:25.536586 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:25.537598 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 09 20:22:25.538000 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:22:25.730194 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-6a88c1b4-bd64-4e3a-bb04-f599d182b30a admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:25.731357 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:22:25.731357 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: warnings.warn(msg) May 09 20:22:25.732558 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-6a88c1b4-bd64-4e3a-bb04-f599d182b30a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:25.733559 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-6a88c1b4-bd64-4e3a-bb04-f599d182b30a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:25.734338 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-6a88c1b4-bd64-4e3a-bb04-f599d182b30a admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:25.734753 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-6a88c1b4-bd64-4e3a-bb04-f599d182b30a admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:25.756496 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-6a88c1b4-bd64-4e3a-bb04-f599d182b30a admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078719 May 09 20:22:25.756992 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 20:22:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:22:37.088463 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:37.089479 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 09 20:22:37.089883 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:22:37.280098 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-38cae6cc-9a6e-431e-9de3-8f186bbe7d72 admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:37.281274 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:22:37.281274 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: warnings.warn(msg) May 09 20:22:37.282445 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-38cae6cc-9a6e-431e-9de3-8f186bbe7d72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:37.282882 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-38cae6cc-9a6e-431e-9de3-8f186bbe7d72 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:37.283690 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-38cae6cc-9a6e-431e-9de3-8f186bbe7d72 admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:37.284116 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-38cae6cc-9a6e-431e-9de3-8f186bbe7d72 admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:37.308366 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-38cae6cc-9a6e-431e-9de3-8f186bbe7d72 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080210 May 09 20:22:37.308860 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 20:22:37 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:22:38.209772 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: DEBUG nova.api.openstack.wsgi [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] Calling method '>' {{(pid=102509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:38.210833 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: INFO nova.api.openstack.requestlog [None req-848c0638-9585-4cbc-82fa-73e0dba749a9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 09 20:22:38.211247 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: [pid: 102509|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 20:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:22:38.400211 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG nova.api.openstack.wsgi [None req-73ae6c96-1376-4257-9f1e-bc48e0711a8b admin admin] Calling method '>' {{(pid=102510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:22:38.401401 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:22:38.401401 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: warnings.warn(msg) May 09 20:22:38.402682 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-73ae6c96-1376-4257-9f1e-bc48e0711a8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:38.403120 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-73ae6c96-1376-4257-9f1e-bc48e0711a8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:38.403932 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-73ae6c96-1376-4257-9f1e-bc48e0711a8b admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:22:38.404440 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: DEBUG oslo_concurrency.lockutils [None req-73ae6c96-1376-4257-9f1e-bc48e0711a8b admin admin] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:22:38.426780 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: INFO nova.api.openstack.requestlog [None req-73ae6c96-1376-4257-9f1e-bc48e0711a8b admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077316 May 09 20:22:38.427252 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: [pid: 102510|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 20:22:38 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:23:35.939337 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: Mon May 9 20:23:35 2022 - graceful shutdown triggered... May 09 20:23:35.939505 dv-cinder-836996-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 09 20:23:35.947078 dv-cinder-836996-15-iscsi devstack@n-api.service[102509]: Gracefully killing worker 1 (pid: 102509)... May 09 20:23:35.947718 dv-cinder-836996-15-iscsi devstack@n-api.service[102510]: Gracefully killing worker 2 (pid: 102510)... May 09 20:23:36.941504 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: worker 1 buried after 1 seconds May 09 20:23:36.941504 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: worker 2 buried after 1 seconds May 09 20:23:36.941504 dv-cinder-836996-15-iscsi devstack@n-api.service[102508]: goodbye to uWSGI. May 09 20:23:36.943007 dv-cinder-836996-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 09 20:23:36.943904 dv-cinder-836996-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 09 20:23:36.946642 dv-cinder-836996-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 20:23:36.960571 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 20:23:36 2022] *** May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: nodename: dv-cinder-836996-15-iscsi May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: machine: x86_64 May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: clock source: unix May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: pcre jit disabled May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: detected number of CPU cores: 4 May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: current working directory: / May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: detected binary path: /usr/bin/uwsgi-core May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: your processes number limit is 47680 May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: your memory page size is 4096 bytes May 09 20:23:36.977690 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: detected max file descriptor number: 2048 May 09 20:23:36.978795 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: lock engine: pthread robust mutexes May 09 20:23:36.978795 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: thunder lock: enabled May 09 20:23:36.978795 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 20:23:36.978795 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 20:23:37.037339 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: Python main interpreter initialized at 0x5625aae309c0 May 09 20:23:37.037339 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: python threads support enabled May 09 20:23:37.037339 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: your server socket listen backlog is limited to 100 connections May 09 20:23:37.037339 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: your mercy for graceful operations on workers is 90 seconds May 09 20:23:37.039044 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: mapped 403077 bytes (393 KB) for 2 cores May 09 20:23:37.039044 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: *** Operational MODE: preforking *** May 09 20:23:37.039044 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: *** uWSGI is running in multiple interpreter mode *** May 09 20:23:37.039044 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: spawned uWSGI master process (pid: 116830) May 09 20:23:37.039044 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: spawned uWSGI worker 1 (pid: 116849, cores: 1) May 09 20:23:37.038254 dv-cinder-836996-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 20:23:37.039527 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: spawned uWSGI worker 2 (pid: 116850, cores: 1) May 09 20:23:37.039760 dv-cinder-836996-15-iscsi devstack@n-api.service[116830]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 20:23:38.271218 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 20:23:38.297848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 20:23:39.090722 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:23:39.090722 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: from cryptography.utils import int_from_bytes May 09 20:23:39.091028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:23:39.091028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: from cryptography.utils import int_from_bytes May 09 20:23:39.109056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:23:39.109056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: from cryptography.utils import int_from_bytes May 09 20:23:39.109397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:23:39.109397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: from cryptography.utils import int_from_bytes May 09 20:23:41.531595 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 20:23:41.532165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 20:23:41.532373 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 20:23:41.532738 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 20:23:41.532996 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 20:23:41.533387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.533716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.534041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.534366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.534705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.535020 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.535344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.535691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.536023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.536288 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.536612 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.536936 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-15-iscsi {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.537261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.537575 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.537886 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.538206 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.538513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.538838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.539146 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.539671 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.540114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.540429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.540745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.541094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.541411 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.541723 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.542045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.542358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.542682 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.542997 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.543412 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-15-iscsi {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.543740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.544059 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.544377 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.544799 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.545115 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.545621 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.545961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.546288 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.546601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.546933 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.547257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.547603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.547929 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.548235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.548547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.548859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.549199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.549490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.549797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.550048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.550357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.550681 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.551006 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.551330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.551599 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.551855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.552172 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.552495 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.552803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.553116 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.553425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.553734 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.554041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.554350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.554663 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.554970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.555291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.555634 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.555957 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.556267 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.556588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.556988 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.557239 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.557547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.557889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.558207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.558517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.558838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.559158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.559490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.559798 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.560106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.560426 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.560749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.561643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.561901 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.562208 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.562516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.562839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.563147 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.563473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.563785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.564086 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.564396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.564708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.565021 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.565331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.565641 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.565947 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.566255 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.566562 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.566879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.567188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.567534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.567838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.568146 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.568452 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.568760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.569082 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.569391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.569698 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.570019 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.570328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.570635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.570956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.571268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.571596 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.571917 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.572223 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.572531 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.572847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.573174 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.573464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.573768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.574074 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.574379 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.574689 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.574992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.575300 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.575630 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.575951 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.576270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.576619 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.577439 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.577747 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.578068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.578408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.578741 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.579086 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.579425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.579765 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.580101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.580425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.580741 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.581059 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.581868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.581868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.582038 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.582294 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.582614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.582934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.583265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.583616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.583937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.584256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.584574 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.584895 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.585224 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.585550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.585864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.586206 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.586551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.586868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.587196 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.587544 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.587861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.588172 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.588484 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.588809 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.589151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.589465 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.589787 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.590101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.590415 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.590727 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.591041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.591355 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.591716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.592034 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.592395 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.592713 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.593033 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.593347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.593659 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.593971 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.594280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.594602 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.594918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.595229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.595562 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.595886 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.596213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.596523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.596857 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.597165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.597477 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.597790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.597886 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 20:23:41.598252 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 20:23:41.598325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.598412 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.598579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 20:23:41.598696 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.598950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 20:23:41.599043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.599211 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 20:23:41.599315 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.599615 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.599720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.599931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.600043 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.600237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.600344 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.600562 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.600661 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.600869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.600959 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.601174 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.601275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.601488 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.601585 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.601798 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.601894 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.602110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.602208 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.602410 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.602513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.602724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.602835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.603045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.603139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-15-iscsi {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.603358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.603492 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.603691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.603794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.604007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.604103 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.604331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.604429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.604641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.604745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.604967 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.605069 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.605276 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.605372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.605597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.605789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.605902 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.606107 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.606198 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.606419 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.606606 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.606737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.606827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.607072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.607161 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.607381 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.607516 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.607705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.607803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.608043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.608283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.608382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.608624 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.608805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.608958 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.609116 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.609279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.609444 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.609686 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-15-iscsi {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.609777 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.610047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.610162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.610329 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.610431 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.610633 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.610729 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.610978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.611075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.611287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.611388 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.611655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.611755 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.611994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.612085 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.612317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.612408 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.612636 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.612750 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.612951 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.613053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.613271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.613362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.613583 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.613680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.613896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.614004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.614209 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.614300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.614521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.614616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.614835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.614938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.615145 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.615240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.615485 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.615579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.615798 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.615897 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.616052 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.616143 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.616371 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.616461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.616701 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.616792 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.617023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.617119 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.617341 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.617449 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.617596 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.617695 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.617852 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.618003 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.618178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.618324 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.618510 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.618648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.618831 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.618960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.619149 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.619276 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.619493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.619599 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.619811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.619909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.620182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.620292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.620437 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.620527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.620739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.620838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.621053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.621144 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.621380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.621482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.621701 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.621792 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.622023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.622113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.622336 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.622428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.622655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.622752 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.622960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.623096 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.623273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.623365 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.624149 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.624283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.624498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.624643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.624827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.624951 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.625146 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.625290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.625474 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.625575 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.625805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.625905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.626120 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.626211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.626436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.626551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.626747 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.626846 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.627053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.627142 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.627364 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.627541 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.627704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.627803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.627958 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.628056 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.628269 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.628361 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.628584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.628683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.628905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.629009 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.629216 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.629307 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.629520 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.629617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.629824 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.629914 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.630129 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.630269 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.630444 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.630577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.630752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.630849 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.631063 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.631152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.631375 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.631522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.631704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.631794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.632010 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.632112 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.632322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.632411 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.632635 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.632739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.632941 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.633037 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.633247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.633338 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.633553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.633727 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.633873 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.633962 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.634186 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.634283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.634490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.634588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.634798 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.634894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.635117 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.635206 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.635446 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.635554 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.635763 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.635861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.636072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.636170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.636383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.636473 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.636944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.637048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.637258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.637355 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.637568 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.637659 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.637878 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.637981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.638188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.638284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.638499 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.638596 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.638808 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.638911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.639739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.639838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.640062 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.640162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.640376 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.640525 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.640685 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.640845 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.640995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.641157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.641304 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.641474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.641617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.641797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.641927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.642237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.642379 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.642546 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.642719 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.642872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.643041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.643199 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.643366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.643544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.643712 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.643860 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.644037 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.644172 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.644374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.644498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:23:41.644709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.644840 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.645056 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.645179 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.645375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.645529 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.645692 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.645851 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.646002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.646191 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.646313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.646530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.646620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.646858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.646957 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.647178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.647275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.647523 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.647632 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.647839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.647928 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.648148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.648247 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.648455 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.648554 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.648759 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.648850 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.649065 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.649156 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.649382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.649485 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.649687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.649813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.650001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.650127 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.650307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.650414 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.650630 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.650720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.650940 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.651033 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.651246 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.651380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.651578 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.651680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.651882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.651972 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.652225 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.652323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.652533 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.652622 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.652871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.652962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.653201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.653292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.653546 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.653635 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.653855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.653952 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.654162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.654252 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.654482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.654589 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.654824 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.654927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.655132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.655387 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.655567 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.655764 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.655864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.656072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.656169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.656378 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.656476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.656691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.656780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.657002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.657101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.657313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.657403 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.657625 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.657722 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.657931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.658022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.658240 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.658331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.658544 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.658642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.658858 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.658948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.659165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.659254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.659501 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.659613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.659805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.659904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.660116 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.660206 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.660424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.660527 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.660728 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.660837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.661036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.661137 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.661339 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.661484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.661655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.661789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.661963 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.662084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.662271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.662456 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.662575 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.662673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.662884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.662981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.663192 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.663285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.663522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.663612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.663849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.663941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.664161 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.664252 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.664467 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.664626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.664771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.664869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.665079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.665178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.665388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.665478 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.665691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.665782 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.665999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.666090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.666392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.666500 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.666629 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.666731 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.666934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.667028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.667242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.667332 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.667571 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.667678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.667877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.667968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.668181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.668278 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.668489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.668590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.668794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.668885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.669096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.669249 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.669399 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.669491 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.669702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.669791 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.670003 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.670104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.670354 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.670446 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.670765 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.670855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.671069 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.671171 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.671373 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.671497 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.671700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.671792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.672045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.672170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.672352 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.672444 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.672665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.672753 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.672977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.673082 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.673289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.673387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.673601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.673706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.673916 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.674022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.674225 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.674322 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.674537 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.674662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.674840 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.674938 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.675146 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.675242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.675479 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.675574 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676348 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676437 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676763 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.676984 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.677084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.677296 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.677394 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.677621 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.677719 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.677947 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.678038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.678275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.678373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.678581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.678673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.678890 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.678988 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.679201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.679308 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.679532 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.679626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.679843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.679933 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.680153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.680256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.680462 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.680563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.680773 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.680863 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.681084 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.681189 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.681396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.681494 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.681706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.681795 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.682013 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.682113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.682324 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.682416 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.682634 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.682735 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.682940 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.683039 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.683264 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.683362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.683600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.683694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.683907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.683998 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.684217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.684307 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.684525 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.684624 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.684838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.684937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.685148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.685238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.685515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.685614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.685832 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.686479 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.686706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.686842 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.687035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.687186 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.687351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.687534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.687688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.687862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.688009 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.688182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.688326 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.688510 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.688632 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.688830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.689051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.689163 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.689366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.689457 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.689680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.689771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.689994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.690095 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.690300 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.690392 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.690605 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.690703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.690918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.691022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.691243 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.691348 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.691572 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.691693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.691877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.692016 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.692184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.692331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.692506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.692651 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.692814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.692972 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.693138 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.693286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.693556 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.693647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.693870 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.693969 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.694178 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.694277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.694510 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.694600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.694828 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.694956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.695139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.695230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.695482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.695590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.695800 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.695900 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.696113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.696206 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.696423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.696522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.696740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.696830 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.697063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.697161 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.697376 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.697475 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.697705 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.697795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.698017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.698104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.698334 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.698433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.698641 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.698730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.698966 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.699056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.699283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.699386 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.699624 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.699715 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.699944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.700045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.700258 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.700350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.700608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.700706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.700925 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.701071 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.701239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.701367 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.701647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.701746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.701961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.702128 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.702292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.702451 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.702549 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.702776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.702866 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.703093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.703195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.703434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.703529 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.703772 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.703871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.704083 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.704173 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.704394 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.704493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.704704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.704794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.705013 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.705134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.705318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.705422 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.705632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.705723 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.705934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.706025 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.706259 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.706353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.706573 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.706673 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.706892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.706984 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.707201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.707290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.707530 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.707636 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.707855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.707960 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.708164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.708431 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.708523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.708762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.708852 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.709068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.709159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.709394 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.709483 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.709702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.709799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.710021 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.710120 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.710350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.710440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.710680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.710779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.710990 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.711087 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.711321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.711458 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.711668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.711796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.711981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.712093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.712292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.712417 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.712612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.712714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.712915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.713017 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.713219 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.713310 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.713528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.713624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.713833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.713924 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.714138 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.714227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.714441 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.714538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.714748 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.714853 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.715063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.715198 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.715353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.715479 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.715680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.715780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.715996 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.716087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.716298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.716432 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.716618 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.716712 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.716927 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.717018 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.717737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.717845 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.718044 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.718345 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.718461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.718638 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.718756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.718965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.719057 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.719297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.719387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.719637 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.719725 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.719957 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.720049 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.720286 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.720376 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.720597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.720694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.720922 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.721021 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.721239 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.721331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.721552 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.721655 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.721863 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.721962 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.722175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.722267 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.722491 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.722646 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.722807 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.722909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.723117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.723207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.723442 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.723552 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.723759 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.723857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.724076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.724174 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.724394 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.724493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.724705 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.724924 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.725015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.725255 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.725368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.725567 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.725657 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.725880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.725971 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.726201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.726299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.726517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.726607 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.726830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.726919 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.727140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.727241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.727473 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.727575 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.727785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.727875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.728093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.728190 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.728418 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.728517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.728748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.728847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.729044 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.729141 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.729355 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.729452 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.729672 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.729763 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.729983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.730082 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.730291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.730381 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.730604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.730695 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.730932 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.731028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.731245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.731386 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.731576 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.731721 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.731891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.731987 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.732201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.732309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.732510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.732660 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.733195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.733288 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.733288 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.733542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.733885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.734172 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.734481 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.734572 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.734794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.734894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.735104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.735194 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.735440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.735546 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.735750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.735852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.736061 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.736192 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.736370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.736488 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.736679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.736781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.736988 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.737087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.737316 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.737416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.737632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.737731 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.737943 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.738040 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.738254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.738352 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.738563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.738776 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.738911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.739095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.739220 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.739448 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.739613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.739779 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.739926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.740107 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.740248 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.740426 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.740579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.740745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.740897 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.741075 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.741213 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.741387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.741535 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.741695 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.741837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.742008 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.742154 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.742320 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.742471 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.742628 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.742792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.742939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.743106 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.743243 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.743434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.743551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.743768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.743861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.744089 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.744189 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.744409 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.744697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.744788 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.745048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.745150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.745368 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.745521 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.745677 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.745778 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.745995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.746095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.746312 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.746402 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.746623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.746713 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.746935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.747034 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.747250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.747347 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.747583 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.747683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.747900 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.747992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.748209 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.748299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.749038 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.749147 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.749346 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.749554 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.749654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.749879 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.749960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.750201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.750306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.750523 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.750615 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.750835 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.750931 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.751162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.751254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.751490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.751598 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.751799 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.751943 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.752104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.752197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.752414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.752513 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.752717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.752854 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.753022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.753113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.753327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.753464 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.753631 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.753786 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.753931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.754108 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.754233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.754423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.754541 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.754743 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.754847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.755062 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.755160 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.755388 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.755491 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.755735 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.755836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.756050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.756184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.756414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.756510 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.756721 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.756813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.757026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.757116 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.757342 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.757442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.757658 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.757753 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.757980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.758071 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.758291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.758380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.758599 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.758691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.758916 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.759012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.759228 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.759332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.759566 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.759794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.759895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.760134 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.760231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.760476 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.760569 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.760790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.760926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.761124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.761253 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.761428 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.761568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.761989 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.762259 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.762351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.762582 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.762674 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.762901 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.762999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.763210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.763299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.763544 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.763652 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.763857 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.763955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.764238 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.764464 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.764565 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.764850 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.764982 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.765160 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.765313 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.765470 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.765656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.765780 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.765998 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.766097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.766328 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.766433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.766658 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.766746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.766978 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.767068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.767315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.767451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.767659 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.767748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.767976 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.768069 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.768291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.768391 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.768600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.768733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.768910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.769069 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.769244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.769392 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.769513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.769726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.769816 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.770060 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.770232 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.770378 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.770469 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.770692 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.770791 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.771011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.771142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.771331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.771480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.771675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.771801 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.772007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.772156 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.772323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.772421 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.772643 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.772734 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.772961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.773109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.773277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.773410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.773590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.773685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.773901 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.774000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.774230 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.774327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.774541 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.774632 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.774869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.774996 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.775192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.775292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.775529 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.775640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.775837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.775928 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.776142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.776242 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.776453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.776556 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.776770 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.776861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.777077 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.777170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.777379 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.777478 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.777689 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.777786 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.777995 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.778083 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.778298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.778398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.778601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.778700 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.778904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.779003 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.779206 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.779299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.779539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.779631 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.779881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.780186 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.780292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.780489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.780652 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.780791 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.780985 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.781078 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.781323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.781413 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.781658 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.781757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.781963 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.782060 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.782267 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.782359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.782570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.782714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.782871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.782977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.783173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.783263 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.783519 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.783638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.783841 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.783959 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.784153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.784244 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.784462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.784551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.784774 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.784874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.785094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.785190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.785403 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.785501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.785723 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.785823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.786040 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.786132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.786353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.786445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.786660 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.786767 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.786968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.787092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.787289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.787385 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.787627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.787720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.787939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.788029 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.788252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.788377 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.788565 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.788674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.788875 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.788966 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.789201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.789290 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.789527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.789620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.789833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.789930 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.790157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.790256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.790473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.790571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.790793 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.790892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.791108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.791209 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.791440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.791548 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.791768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.791861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.792080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.792184 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.792390 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.792491 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.792705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.792804 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.793016 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.793108 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.793326 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.793611 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.793716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.793943 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.794049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.794266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.794364 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.794588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.794678 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.794912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.795019 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.795233 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.795864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.796112 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.796336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.796568 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.796716 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.796818 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.797030 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.797133 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.797358 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.797459 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.797672 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.797762 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.797974 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.798072 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.798220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 20:23:41.798326 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.798655 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.799004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.799333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.799687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.800013 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.800339 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.800706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.801033 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.801351 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.801674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.802004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.802326 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.802646 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.802966 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.803291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.803665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.803969 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.804289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.804610 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.804933 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.805264 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.805608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.805937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.806258 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.806580 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.806904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.807458 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.807788 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.808131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.808466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.808800 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.809125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.809452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.809786 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.810102 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.810417 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.810735 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.811204 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.811516 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.811855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.812177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.812493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.812822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.813141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.813687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.814044 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.814366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.814701 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.815034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.815358 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.815737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.817090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.817090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.817090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.817090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.817465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.817602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.817920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.818241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.818556 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.818870 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.819190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.819534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.819871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.820185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.820498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.820809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.821127 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.821440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.821756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.822067 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.822377 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.822539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_db.sqlalchemy.engines [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:41.822712 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.822990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.823304 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.823640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.823961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.824275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.824588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.824956 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.825291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.825603 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.825911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.826238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.828047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.828047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.828047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.828047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.828669 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.828833 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.829289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.829633 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.829962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.830307 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.830648 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.830964 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.831280 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.831690 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.832023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.832348 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.832665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.832982 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.833299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.833615 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.833931 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.834249 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.834562 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.834875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.835189 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.835529 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.835845 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.836165 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.836513 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.836838 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.837160 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.837484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.837805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.838122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.838439 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.838754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.839069 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.839402 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.839752 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.840073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.840387 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.840824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.841145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.841473 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.841803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.842121 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.842570 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.842923 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.843260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.843616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.843937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.844280 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.844628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.844964 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.845299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.845613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.845927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.846241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.846561 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.846887 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.847202 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.847542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.847857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.848171 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.848482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.848795 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.849107 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.849416 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.849730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.850038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.850347 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.850655 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.850964 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.851274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.851609 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.851926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.852237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.852548 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.852857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.853169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.853476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.853829 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.854154 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.854476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.854806 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.855120 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.855472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.855790 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.856117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.856446 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.856771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.857085 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.857430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.857747 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.858612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.859012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.859341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.859687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.860005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.860340 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.860675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.860990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.861322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.861647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.861975 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.862297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.862617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.862954 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.863274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.863614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.863937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.864256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.864571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.864896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.865218 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.865551 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.865886 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.866220 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.866555 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.866911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.867233 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.867612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.868005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.868279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.868597 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.868908 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:23:41.869157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 20:23:41.888490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.context [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),226b11f8-5e53-483b-be5e-f910c39e1ec6(cell1) {{(pid=116849) load_cells /opt/stack/nova/nova/context.py:464}} May 09 20:23:41.893555 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:23:41.893727 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_db.sqlalchemy.engines [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:41.895171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:23:41.896024 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:23:41.897991 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:23:41.910841 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_db.sqlalchemy.engines [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:41.912104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_db.sqlalchemy.engines [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:41.963356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.context [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),226b11f8-5e53-483b-be5e-f910c39e1ec6(cell1) {{(pid=116850) load_cells /opt/stack/nova/nova/context.py:464}} May 09 20:23:41.968578 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:23:41.970153 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:23:41.970970 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:23:41.972956 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:23:41.986248 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_db.sqlalchemy.engines [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:41.988178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_db.sqlalchemy.engines [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:42.074146 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_db.sqlalchemy.engines [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:42.152854 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_db.sqlalchemy.engines [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:23:42.393165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: WARNING keystonemiddleware.auth_token [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:23:42.400803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: WARNING keystonemiddleware.auth_token [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:23:42.484026 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: WARNING keystonemiddleware.auth_token [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:23:42.492232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: WARNING keystonemiddleware.auth_token [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:23:42.746145 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: WARNING keystonemiddleware.auth_token [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:23:42.753243 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: WARNING keystonemiddleware.auth_token [None req-a451bd63-163f-429a-b8f5-275b6ddf663d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:23:42.758688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625aae309c0 pid: 116849 (default app) May 09 20:23:42.843722 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: WARNING keystonemiddleware.auth_token [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 20:23:42.850003 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: WARNING keystonemiddleware.auth_token [None req-2867e4cf-c009-4d5b-8f67-dbcf2c5cb5f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 20:23:42.855211 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625aae309c0 pid: 116850 (default app) May 09 20:24:26.148662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-19b88519-f0aa-484c-be0c-9e35741c74d8 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Action: 'create', calling method: .version_select at 0x7f62bf489280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1910851758", "metadata": {"Type": "work"}}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-19b88519-f0aa-484c-be0c-9e35741c74d8 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Request method failure captured: May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 122 May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXh4AOKDmu8ZrTZGjkFL_trh7zn6Fvcric0at4zRM4rdlXl__W3p18okLQQIs-tFuaNI7JL1I0R2nBIgO1Cf0zNwc17BZh88E2SFcOeOuWXhLdzkICpmIj8UzizFXQny58x4vqtYahMCb5ZGav9ziBcNhEw4ZRkMBeO7P2f7fL1ldcU May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:24:26.168445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a703048ebbc44d497f95e1c5e221875"}]}] May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: d2608eb3457640fc9858ce38ce943947 May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1910851758", "metadata": {"Type": "work"}}} May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: May 09 20:24:26.171603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1910851758', 'metadata': {'Type': 'work'}}}} May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise error May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi '#$%' May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:24:26.172416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 20:24:26.173752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 20:24:26.174921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 20:24:26.174921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.179306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-19b88519-f0aa-484c-be0c-9e35741c74d8 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:24:26.181378 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-19b88519-f0aa-484c-be0c-9e35741c74d8 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.459505 May 09 20:24:26.183181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 20:24:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1463 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 20:24:26.884337 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d09cd2ab-f998-4e15-8f14-65d842a3c2f7 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Action: 'create', calling method: .version_select at 0x7f62bf518ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1488243323", "metadata": {"Type": "work"}}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d09cd2ab-f998-4e15-8f14-65d842a3c2f7 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Request method failure captured: May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 120 May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXh4AOKDmu8ZrTZGjkFL_trh7zn6Fvcric0at4zRM4rdlXl__W3p18okLQQIs-tFuaNI7JL1I0R2nBIgO1Cf0zNwc17BZh88E2SFcOeOuWXhLdzkICpmIj8UzizFXQny58x4vqtYahMCb5ZGav9ziBcNhEw4ZRkMBeO7P2f7fL1ldcU May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:24:26.891992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a703048ebbc44d497f95e1c5e221875"}]}] May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: d2608eb3457640fc9858ce38ce943947 May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1488243323", "metadata": {"Type": "work"}}} May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: May 09 20:24:26.893472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1488243323', 'metadata': {'Type': 'work'}}}} May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise error May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi '0' May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:24:26.894320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 20:24:26.896450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 20:24:26.898949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 20:24:26.898949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:26.900536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d09cd2ab-f998-4e15-8f14-65d842a3c2f7 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:24:26.902935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d09cd2ab-f998-4e15-8f14-65d842a3c2f7 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.713239 May 09 20:24:26.904869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 20:24:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 717 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 09 20:24:26.914848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ce3e82cd-50ce-4646-82e4-4e53b89b0dbe tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Action: 'create', calling method: .version_select at 0x7f62bf32d5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1982097622", "metadata": {"Type": "work"}}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ce3e82cd-50ce-4646-82e4-4e53b89b0dbe tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Request method failure captured: May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 119 May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXh4AOKDmu8ZrTZGjkFL_trh7zn6Fvcric0at4zRM4rdlXl__W3p18okLQQIs-tFuaNI7JL1I0R2nBIgO1Cf0zNwc17BZh88E2SFcOeOuWXhLdzkICpmIj8UzizFXQny58x4vqtYahMCb5ZGav9ziBcNhEw4ZRkMBeO7P2f7fL1ldcU May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:24:26.918229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a703048ebbc44d497f95e1c5e221875"}]}] May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: d2608eb3457640fc9858ce38ce943947 May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1982097622", "metadata": {"Type": "work"}}} May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: May 09 20:24:26.920114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1982097622', 'metadata': {'Type': 'work'}}}} May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise error May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi '' May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:24:26.921057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 20:24:26.923884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 20:24:26.927374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 20:24:26.927374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:24:26.927374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ce3e82cd-50ce-4646-82e4-4e53b89b0dbe tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:24:26.927374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ce3e82cd-50ce-4646-82e4-4e53b89b0dbe tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010042 May 09 20:24:26.927374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 20:24:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 20:24:26.931644 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e75777b0-1b7c-43f8-92d0-fda50eee8156 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Calling method '.version_select at 0x7f62bf373280>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:28.324383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-121953100", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "networks": [{"uuid": "5be41a08-5cc5-4afe-83ed-05f4c7a9e107"}]}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:28.328920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-e75777b0-1b7c-43f8-92d0-fda50eee8156 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] HTTP exception thrown: Volume tempest-invalid-1953290625 could not be found. May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e75777b0-1b7c-43f8-92d0-fda50eee8156 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Request method failure captured: May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1953290625 HTTP/1.1 May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXh4AOKDmu8ZrTZGjkFL_trh7zn6Fvcric0at4zRM4rdlXl__W3p18okLQQIs-tFuaNI7JL1I0R2nBIgO1Cf0zNwc17BZh88E2SFcOeOuWXhLdzkICpmIj8UzizFXQny58x4vqtYahMCb5ZGav9ziBcNhEw4ZRkMBeO7P2f7fL1ldcU May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:24:28.334430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a703048ebbc44d497f95e1c5e221875"}]}] May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: d2608eb3457640fc9858ce38ce943947 May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Volume tempest-invalid-1953290625 could not be found. May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'tempest-invalid-1953290625'} May 09 20:24:28.336260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1953290625 could not be found. (HTTP 404) (Request-ID: req-713de0a1-8bb3-43e8-baf4-4495833e6dfa) May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 20:24:28.338768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1953290625 could not be found. May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:24:28.340506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1953290625 could not be found. May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1953290625 could not be found. May 09 20:24:28.342466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.344842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e75777b0-1b7c-43f8-92d0-fda50eee8156 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Returning 404 to user: Volume tempest-invalid-1953290625 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:24:28.346177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e75777b0-1b7c-43f8-92d0-fda50eee8156 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1953290625" status: 404 len: 99 microversion: 2.1 time: 1.418648 May 09 20:24:28.352482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 20:24:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1953290625 => generated 99 bytes in 1426 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 09 20:24:28.362889 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c11c2a68-0ce4-4fb1-bf5f-196131b87156 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006347 May 09 20:24:28.363499 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 3/5] 10.222.0.44 () {58 vars in 1139 bytes} [Mon May 9 20:24:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 20:24:28.375894 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-77e5cdf8-8ca0-439e-bfe3-f3554bd6a964 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006067 May 09 20:24:28.376873 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 4/6] 10.222.0.44 () {58 vars in 1136 bytes} [Mon May 9 20:24:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 20:24:28.391707 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-358c6cf4-40a4-4771-acb7-1d68e8fc147a tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Calling method '.version_select at 0x7f62bf259160>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:28.557012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-358c6cf4-40a4-4771-acb7-1d68e8fc147a tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] HTTP exception thrown: Volume b2b45896-e66f-450f-ad4c-fef0de137a48 could not be found. May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-358c6cf4-40a4-4771-acb7-1d68e8fc147a tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Request method failure captured: May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: DELETE /compute/v2.1/os-volumes/b2b45896-e66f-450f-ad4c-fef0de137a48 HTTP/1.1 May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXh4AOKDmu8ZrTZGjkFL_trh7zn6Fvcric0at4zRM4rdlXl__W3p18okLQQIs-tFuaNI7JL1I0R2nBIgO1Cf0zNwc17BZh88E2SFcOeOuWXhLdzkICpmIj8UzizFXQny58x4vqtYahMCb5ZGav9ziBcNhEw4ZRkMBeO7P2f7fL1ldcU May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:24:28.561775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a703048ebbc44d497f95e1c5e221875"}]}] May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: d2608eb3457640fc9858ce38ce943947 May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Volume b2b45896-e66f-450f-ad4c-fef0de137a48 could not be found. May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'b2b45896-e66f-450f-ad4c-fef0de137a48'} May 09 20:24:28.563254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2b45896-e66f-450f-ad4c-fef0de137a48 could not be found. (HTTP 404) (Request-ID: req-4bf368c0-3f0f-408b-b599-a2740f3ca893) May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.564792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 20:24:28.566843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2b45896-e66f-450f-ad4c-fef0de137a48 could not be found. May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 20:24:28.568571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2b45896-e66f-450f-ad4c-fef0de137a48 could not be found. May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2b45896-e66f-450f-ad4c-fef0de137a48 could not be found. May 09 20:24:28.571080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.572619 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-358c6cf4-40a4-4771-acb7-1d68e8fc147a tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Returning 404 to user: Volume b2b45896-e66f-450f-ad4c-fef0de137a48 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:24:28.573643 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-358c6cf4-40a4-4771-acb7-1d68e8fc147a tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b2b45896-e66f-450f-ad4c-fef0de137a48" status: 404 len: 109 microversion: 2.1 time: 0.188111 May 09 20:24:28.581967 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 5/7] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:24:28 2022] DELETE /compute/v2.1/os-volumes/b2b45896-e66f-450f-ad4c-fef0de137a48 => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:24:28.590383 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-01ff022a-ff01-4183-aaf4-7e9bcdca6649 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Calling method '.version_select at 0x7f62bf2591f0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:28.635752 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-01ff022a-ff01-4183-aaf4-7e9bcdca6649 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] HTTP exception thrown: Volume 5c738227-1560-4eeb-be38-be58c0d0a371 could not be found. May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-01ff022a-ff01-4183-aaf4-7e9bcdca6649 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Request method failure captured: May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/os-volumes/5c738227-1560-4eeb-be38-be58c0d0a371 HTTP/1.1 May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXh4AOKDmu8ZrTZGjkFL_trh7zn6Fvcric0at4zRM4rdlXl__W3p18okLQQIs-tFuaNI7JL1I0R2nBIgO1Cf0zNwc17BZh88E2SFcOeOuWXhLdzkICpmIj8UzizFXQny58x4vqtYahMCb5ZGav9ziBcNhEw4ZRkMBeO7P2f7fL1ldcU May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:24:28.639501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a703048ebbc44d497f95e1c5e221875"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a703048ebbc44d497f95e1c5e221875"}]}] May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 4a703048ebbc44d497f95e1c5e221875 May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesNegativeTest-1859904754 May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: d2608eb3457640fc9858ce38ce943947 May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesNegativeTest-1859904754-project May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Volume 5c738227-1560-4eeb-be38-be58c0d0a371 could not be found. May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '5c738227-1560-4eeb-be38-be58c0d0a371'} May 09 20:24:28.641229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c738227-1560-4eeb-be38-be58c0d0a371 could not be found. (HTTP 404) (Request-ID: req-c56bad55-e9cd-4b78-9ed0-2d5b57429ebf) May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.642341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:24:28.644706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c738227-1560-4eeb-be38-be58c0d0a371 could not be found. May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 20:24:28.647245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c738227-1560-4eeb-be38-be58c0d0a371 could not be found. May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c738227-1560-4eeb-be38-be58c0d0a371 could not be found. May 09 20:24:28.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:24:28.654616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-01ff022a-ff01-4183-aaf4-7e9bcdca6649 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] Returning 404 to user: Volume 5c738227-1560-4eeb-be38-be58c0d0a371 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:24:28.654616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-01ff022a-ff01-4183-aaf4-7e9bcdca6649 tempest-VolumesNegativeTest-1859904754 tempest-VolumesNegativeTest-1859904754-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/5c738227-1560-4eeb-be38-be58c0d0a371" status: 404 len: 109 microversion: 2.1 time: 0.070196 May 09 20:24:28.669199 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 6/8] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:24:28 2022] GET /compute/v2.1/os-volumes/5c738227-1560-4eeb-be38-be58c0d0a371 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:24:28.806298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] validate_networks() for [('5be41a08-5cc5-4afe-83ed-05f4c7a9e107', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:24:30.330268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:24:30.332351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:24:30.334438 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:24:30.335290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:24:30.336579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:24:30.384889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:30.385489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:30.389300 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:30.389943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:30.484768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Getting quotas for project b9825a892fe14e409eb97a504d3c8b92. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:30.511159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Getting quotas for user c6ed7ee782974e199e6202aca7b6e9e3 and project b9825a892fe14e409eb97a504d3c8b92. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:30.574398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:24:30.590359 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:24:30.846188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-cca4ecd1-fa87-44cd-93f8-3cab7fb7ed02 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.609613 May 09 20:24:30.846840 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 3/9] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:24:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:24:30.861098 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-318b9915-d420-430b-afbe-846fe91596c5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:30.861985 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-318b9915-d420-430b-afbe-846fe91596c5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:31.436623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-318b9915-d420-430b-afbe-846fe91596c5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:31.469354 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-318b9915-d420-430b-afbe-846fe91596c5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1214 microversion: 2.1 time: 0.615520 May 09 20:24:31.470201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 7/10] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:30 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1214 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:32.488290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7b04e0f1-77a7-4d31-9c07-64dfb2e4fb42 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:32.488904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7b04e0f1-77a7-4d31-9c07-64dfb2e4fb42 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:32.662715 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7b04e0f1-77a7-4d31-9c07-64dfb2e4fb42 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:32.687117 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7b04e0f1-77a7-4d31-9c07-64dfb2e4fb42 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1214 microversion: 2.1 time: 0.203270 May 09 20:24:32.688844 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 4/11] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:32 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:33.708768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:33.709399 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:33.730869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:33.732050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:33.733633 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:33.734089 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:35.148996 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:35.179169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-53d7cde0-5f4f-495e-a8b1-6e00d9a79666 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1266 microversion: 2.1 time: 1.472053 May 09 20:24:35.179986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 8/12] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:33 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1266 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:36.197707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:36.199016 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:36.214033 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:36.214709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:36.216380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:36.216970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:37.240925 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:37.268992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3149f1b3-a647-4aa1-8f6f-e5ec6972d6b7 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1272 microversion: 2.1 time: 1.075705 May 09 20:24:37.271498 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 5/13] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:36 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1272 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:38.144120 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2047186262", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:38.289578 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:38.291697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:38.308010 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:38.312265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:38.324235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:38.325799 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:38.513754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] validate_networks() for [('b5211c87-473c-4568-883c-02b482c6282d', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:24:38.686411 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:38.701094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a5112a1f-148f-4589-a4ba-7baa2a6987fd tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1272 microversion: 2.1 time: 0.417044 May 09 20:24:38.713813 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 6/14] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:38 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1272 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:39.721989 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:39.723464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:39.741432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:39.752791 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:39.755655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:39.756604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:40.211750 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:40.229143 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-aad212b3-8964-406b-b000-e1626cafce88 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.507297 May 09 20:24:40.231943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 7/15] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:39 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:40.401151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ef28a030-bd65-466b-ba1b-4c39128047c0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: .version_select at 0x7f62be1f0af0>, body: {"keypair": {"name": "tempest-keypair-1142749524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn44qeFscE683qSfYvBqpnP3rhV/KIJtC/ndSIzU5lIvJlnqOvE+oGOngNV9jdVZR/Zq4vRgrGgjMBJLRGPk6wHwkK1OIjJGuvHzu1hTAOaiGZ68OCKoQjbQr+nFpl28Q=="}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:40.555447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-ef28a030-bd65-466b-ba1b-4c39128047c0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:40.577135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-ef28a030-bd65-466b-ba1b-4c39128047c0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:40.733433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ef28a030-bd65-466b-ba1b-4c39128047c0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.487927 May 09 20:24:40.751652 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 8/16] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:24:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:24:41.256261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:41.257592 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:41.275095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:41.278636 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:41.280143 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:41.281666 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:42.020101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:42.048430 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9e38d455-57a1-4c89-87ea-da525bfff9fb tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.788363 May 09 20:24:42.049080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 9/17] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:41 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:43.067942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:43.068597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:43.089331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:43.090059 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:43.091578 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:43.092236 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:43.967897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:43.993252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e1e2a89e-0c17-4600-a94a-9645873842dc tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.923575 May 09 20:24:44.003075 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 10/18] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:43 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:44.978374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:24:44.978858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:24:44.979259 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:24:44.979678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:24:44.980251 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:24:45.017723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:45.018169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:45.020993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:45.022471 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:45.025413 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:45.025864 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:45.030764 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:45.032476 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:45.034969 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:45.036597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:45.102176 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for project 96a116cd334648f185dbf35bfa3ade00. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:45.121075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for user 797d7c0dfda747549456236e9e639466 and project 96a116cd334648f185dbf35bfa3ade00. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:45.150065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:24:45.153066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:24:45.267421 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ceca4092-f52a-4d8f-946e-50743b1e6f77 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.464629 May 09 20:24:45.269138 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 9/19] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:24:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 7468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:24:45.283291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-806ea244-c1ff-46ed-b18c-dc5d50135a01 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:45.284434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-806ea244-c1ff-46ed-b18c-dc5d50135a01 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:45.571762 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-806ea244-c1ff-46ed-b18c-dc5d50135a01 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:45.579939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:45.589559 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-be021602-cdc4-48bc-b5c3-cd02d7193233 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.572720 May 09 20:24:45.592824 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 11/20] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:45 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:45.604738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-806ea244-c1ff-46ed-b18c-dc5d50135a01 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1222 microversion: 2.1 time: 0.328824 May 09 20:24:45.635789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 10/21] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:45 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1222 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:45.740769 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-366651811", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:45.864447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] validate_networks() for [('b5211c87-473c-4568-883c-02b482c6282d', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:24:46.614957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:46.616461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:46.636885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:46.638205 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:46.643755 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:46.649380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:47.534771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:24:47.535835 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:24:47.536908 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:24:47.537567 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:24:47.538247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:24:47.557739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:47.560875 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:47.565465 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:47.566317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:47.631772 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for project 96a116cd334648f185dbf35bfa3ade00. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:47.638240 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for user 797d7c0dfda747549456236e9e639466 and project 96a116cd334648f185dbf35bfa3ade00. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:47.657829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:24:47.660366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:24:47.733706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:47.742432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d56163d4-bec2-4c9a-8f53-450a48e20e90 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.007167 May 09 20:24:47.744209 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 12/22] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:24:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:24:47.752651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-476035042", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faed6f7c-f550-49ae-a092-e26879c69bec"}], "security_groups": [{"name": "tempest-securitygroup--1257130435"}], "key_name": "tempest-keypair-1142749524", "user_data": "}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:47.757108 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ad4da4cf-721d-464c-bcc0-26020253e154 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 1.151669 May 09 20:24:47.757910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:46 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:47.762590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5b6c5ebd-e184-46a2-a960-4b8af0534748 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:47.763303 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5b6c5ebd-e184-46a2-a960-4b8af0534748 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:48.016803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] validate_networks() for [('faed6f7c-f550-49ae-a092-e26879c69bec', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:24:48.378903 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5b6c5ebd-e184-46a2-a960-4b8af0534748 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:48.387452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5b6c5ebd-e184-46a2-a960-4b8af0534748 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1221 microversion: 2.1 time: 0.628263 May 09 20:24:48.403961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 12/24] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:47 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1221 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:48.539771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-74a67b35-f822-49d7-93c6-e8b58a84e113 req-556ea2c7-6b52-4434-b016-8ba254b65bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb02ec29-edbc-4126-beaf-29b18aa9557f", "tag": "78543ee9-a62c-4f54-bf13-c8bbb28f3c08"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:48.577414 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-74a67b35-f822-49d7-93c6-e8b58a84e113 req-556ea2c7-6b52-4434-b016-8ba254b65bb7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:48.582429 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-74a67b35-f822-49d7-93c6-e8b58a84e113 req-556ea2c7-6b52-4434-b016-8ba254b65bb7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:48.592624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:24:48.593596 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:24:48.594234 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:24:48.594783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:24:48.595333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:24:48.611570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:48.613363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:48.613363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:48.613853 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:48.653394 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-74a67b35-f822-49d7-93c6-e8b58a84e113 req-556ea2c7-6b52-4434-b016-8ba254b65bb7 service nova] Creating event network-changed:78543ee9-a62c-4f54-bf13-c8bbb28f3c08 for instance bb02ec29-edbc-4126-beaf-29b18aa9557f on hv-cinder-83699 May 09 20:24:48.655226 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-74a67b35-f822-49d7-93c6-e8b58a84e113 req-556ea2c7-6b52-4434-b016-8ba254b65bb7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 20:24:48.657466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a0fcf3a3-c95f-4b91-80da-b6338ef442db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:48.660823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a0fcf3a3-c95f-4b91-80da-b6338ef442db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:48.662118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a0fcf3a3-c95f-4b91-80da-b6338ef442db None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:48.662831 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a0fcf3a3-c95f-4b91-80da-b6338ef442db None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:48.679283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:48.686788 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.compute.rpcapi [None req-a0fcf3a3-c95f-4b91-80da-b6338ef442db None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 20:24:48.687265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:48.688262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a0fcf3a3-c95f-4b91-80da-b6338ef442db None None] Releasing lock "compute-rpcapi-router" {{(pid=116850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 20:24:48.719845 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:24:48.724728 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:24:48.725162 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a0fcf3a3-c95f-4b91-80da-b6338ef442db None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319433 May 09 20:24:48.725857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 13/25] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:24:48.776137 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:48.777811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:48.792987 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:48.801428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:48.807248 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:48.808064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:48.862560 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-22a67169-44b6-4eb0-b561-ddb9d2d037dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.116984 May 09 20:24:48.866885 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 13/26] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:24:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:24:48.882396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7a88f7fb-cc5a-4138-b2a1-d2bb04db9cfd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:48.884640 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7a88f7fb-cc5a-4138-b2a1-d2bb04db9cfd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:48.970461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7a88f7fb-cc5a-4138-b2a1-d2bb04db9cfd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:48.979860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7a88f7fb-cc5a-4138-b2a1-d2bb04db9cfd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1241 microversion: 2.1 time: 0.106101 May 09 20:24:48.982313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 14/27] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:48 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:49.410001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:49.410956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:49.412751 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:49.420918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3db726b2-8837-4a09-a435-09f0dc381010 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.649661 May 09 20:24:49.422443 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:49.424137 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:49.424887 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 14/28] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:48 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:49.430154 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:49.432373 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:49.526461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:49.537700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6c2c2053-b862-4e6e-9439-9f14782275d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1225 microversion: 2.1 time: 0.132995 May 09 20:24:49.538379 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 15/29] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:49 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:49.984716 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d1ffb929-1fe5-49c6-b3e3-aac11cc388b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'create', calling method: .version_select at 0x7f62bf0d5700>, body: {"keypair": {"name": "tempest-keypair-1215121233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjT7dxuNqT8rsYSmRmf3jplfpY2OgfrlHldUlHHn/He20CiFszbK9LuYUKcI+OMEbUbUQJWceNunZla6KL2tgKCf9hmPD46GjoICE3/as6ZsSF7o9A4gedJ6v3o7eaubg=="}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:50.002894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:50.003565 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:50.029654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:50.030108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:50.030898 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:50.031335 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:50.165732 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-d1ffb929-1fe5-49c6-b3e3-aac11cc388b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for project 1689d104c0184a36816bb6e361733e16. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:50.209886 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-d1ffb929-1fe5-49c6-b3e3-aac11cc388b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for user d9342c8759514113aeec13ce910e4a21 and project 1689d104c0184a36816bb6e361733e16. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:50.251802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:50.262643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6f686903-90de-4138-8f15-b25638dc2d8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1245 microversion: 2.1 time: 0.267222 May 09 20:24:50.264095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 16/30] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:49 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1245 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:50.364224 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d1ffb929-1fe5-49c6-b3e3-aac11cc388b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.467396 May 09 20:24:50.366944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 15/31] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:24:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:24:50.462209 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:50.463091 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:50.505873 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:50.506427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:50.512849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:50.522664 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:50.559926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:50.563049 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:50.590637 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:50.592351 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:50.598322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:50.598990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:51.107956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:51.119134 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-94995af4-4ec6-4607-bd9b-235601ef0a27 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.678768 May 09 20:24:51.124133 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 17/32] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:50 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:51.132653 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:51.143586 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cfdeecb9-c0ed-4538-bacc-d7e192cbe377 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1225 microversion: 2.1 time: 0.590940 May 09 20:24:51.161709 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 16/33] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:50 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1225 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:51.280292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:51.281053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:51.292112 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:51.294107 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:51.295253 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:51.297142 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:51.313199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ea1bcc27-7e12-4acb-9b80-c3ca46763f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'create', calling method: .version_select at 0x7f62be0f7310>, body: {"keypair": {"name": "tempest-keypair-1595899172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4uMlY6Q8Giv6eiJoJpY7HPXjA1fpN7DX2z/gt0clCSB/TJiRRaYdtVOKiXEyokquglG4ljG1PxHxH88Qzpku69x58dDnWluRVHoPyWpGDieuBoqVm+iGxlQN8gGY5acA=="}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:51.357567 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-ea1bcc27-7e12-4acb-9b80-c3ca46763f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for project f579878e20bc40d282c9c38200581b98. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:51.373887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-ea1bcc27-7e12-4acb-9b80-c3ca46763f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for user 38716aefb55246079de2658159fd5ca4 and project f579878e20bc40d282c9c38200581b98. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:51.433224 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ea1bcc27-7e12-4acb-9b80-c3ca46763f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.217660 May 09 20:24:51.434370 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 18/34] 10.222.0.44 () {62 vars in 1199 bytes} [Mon May 9 20:24:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 219 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 09 20:24:51.447471 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:51.456911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e2ea8f4c-652f-4ba4-8ea1-3e6c9ca29edf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1293 microversion: 2.1 time: 0.181244 May 09 20:24:51.457753 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 17/35] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:51 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:52.137813 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:52.138569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:52.149251 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:52.149850 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:52.150778 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:52.154288 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:52.169971 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:52.170643 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:52.180814 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:52.182867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:52.184777 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:52.185267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:52.328087 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:52.335673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8365df9c-cde7-40d6-950f-bcdb15c0fe76 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1217 microversion: 2.1 time: 0.170432 May 09 20:24:52.336161 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 18/36] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:52 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:52.474338 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:52.475576 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:52.491251 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:52.492111 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:52.493170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:52.493750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:52.646449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:52.668329 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-75e7b13c-5c69-4945-9f29-ea24908c2dea tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.527347 May 09 20:24:52.671990 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 19/37] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:52 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:52.854626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:52.870038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6b360452-e57d-4f5f-90db-34047f36230f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1293 microversion: 2.1 time: 0.399742 May 09 20:24:52.870902 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 19/38] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:52 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1293 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:53.354264 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:53.354986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:53.374591 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:53.378517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:53.382763 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:53.383515 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:53.548079 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1677997972", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f375c59-80e0-462b-90e2-c85c57ac95d7"}], "security_groups": [{"name": "tempest-securitygroup--573591615"}], "key_name": "tempest-keypair-1215121233", "user_data": "}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:53.549887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:53.565126 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-da77c46a-e2aa-408c-beb1-5bbf9c216ed1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1217 microversion: 2.1 time: 0.214972 May 09 20:24:53.567532 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 20/39] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:53 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:53.689496 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:53.690392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:53.699636 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:53.702870 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:53.705465 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:53.705912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:53.736538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] validate_networks() for [('7f375c59-80e0-462b-90e2-c85c57ac95d7', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:24:53.970646 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:53.978361 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-10afc797-d7e1-4208-a0dc-dcb3a0cc9388 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.293635 May 09 20:24:53.982972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 21/40] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:53 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:53.988450 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:53.992327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:54.010076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.012860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.015322 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.016665 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.148979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:54.184983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7523afe3-121f-4bd9-9e77-1ae6828aa612 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1293 microversion: 2.1 time: 0.199606 May 09 20:24:54.186324 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 22/41] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:53 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1293 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:54.232107 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-522630786", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "879061ea-c49d-454e-abf2-ebb593b2f042"}], "security_groups": [{"name": "tempest-securitygroup--1142787236"}], "key_name": "tempest-keypair-1595899172", "user_data": "}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:24:54.368913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] validate_networks() for [('879061ea-c49d-454e-abf2-ebb593b2f042', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:24:54.469604 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:24:54.470035 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:24:54.470511 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:24:54.471113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:24:54.471632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:24:54.481956 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.482402 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.483414 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.483879 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.502160 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for project 1689d104c0184a36816bb6e361733e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:54.506702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for user d9342c8759514113aeec13ce910e4a21 and project 1689d104c0184a36816bb6e361733e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:54.519333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:24:54.521794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:24:54.597822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9a5703c4-49ec-45ed-836f-02d7506df4cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.062570 May 09 20:24:54.600640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 20/42] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:24:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:24:54.613945 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:54.615925 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:54.629247 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.629988 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.630999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.633176 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.758348 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:54.778804 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b2965546-32c1-4bce-a2d7-f634c06e6a49 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1217 microversion: 2.1 time: 0.176714 May 09 20:24:54.786493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 21/43] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:54 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:54.805571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-bd06ae6f-54a7-4471-bb48-7b6d770cc0ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:54.811913 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-bd06ae6f-54a7-4471-bb48-7b6d770cc0ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:54.897968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bd06ae6f-54a7-4471-bb48-7b6d770cc0ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:54.909693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-bd06ae6f-54a7-4471-bb48-7b6d770cc0ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1238 microversion: 2.1 time: 0.121500 May 09 20:24:54.911539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 22/44] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:54 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:54.951432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:24:54.951951 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:24:54.952467 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:24:54.952829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:24:54.956819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:24:54.971292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.971807 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.973645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:54.974055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:54.999440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:55.000279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:55.010984 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.011462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:55.015695 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.016794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:55.030440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for project f579878e20bc40d282c9c38200581b98. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:24:55.041879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for user 38716aefb55246079de2658159fd5ca4 and project f579878e20bc40d282c9c38200581b98. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:24:55.073789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:24:55.081052 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:24:55.190913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9ec29a20-7b7e-4123-9662-383eeceff9fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.962769 May 09 20:24:55.192113 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 23/45] 10.222.0.44 () {62 vars in 1187 bytes} [Mon May 9 20:24:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 09 20:24:55.204790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0170cb21-378c-46d7-bc8d-8c157735c82b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:55.206352 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0170cb21-378c-46d7-bc8d-8c157735c82b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:55.369501 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0170cb21-378c-46d7-bc8d-8c157735c82b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:55.386408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0170cb21-378c-46d7-bc8d-8c157735c82b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:55.389978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0170cb21-378c-46d7-bc8d-8c157735c82b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:55.391152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0170cb21-378c-46d7-bc8d-8c157735c82b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1281 microversion: 2.20 time: 0.193121 May 09 20:24:55.391777 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:24:55 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:24:55.414921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:55.419056 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:55.438661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.439200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:55.442920 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.444528 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:55.599676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:55.603683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:55.609286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0373cf5e-2519-4cdf-9c7d-6d0eeeba449b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.614141 May 09 20:24:55.610458 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 23/47] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:54 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:55.620790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0e635037-229a-4371-89eb-167dd21424b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1293 microversion: 2.1 time: 0.220819 May 09 20:24:55.622876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 25/48] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:55 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1293 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:55.803981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:55.805065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:55.812575 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.814055 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:55.815123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.815856 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:55.904770 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:55.915820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1ced2a3e-1b0d-4e12-a9f6-d1de525fa569 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1273 microversion: 2.1 time: 0.118388 May 09 20:24:55.928181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 24/49] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:55 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:55.929081 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:55.929950 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:55.943266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.943739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:55.944508 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:55.944936 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:56.025753 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:56.039362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-842ac178-e1c2-41c0-be5f-fb69a31198ec tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1234 microversion: 2.1 time: 0.114570 May 09 20:24:56.040186 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 26/50] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:55 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1234 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:56.421197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:56.421668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:56.437876 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:56.439284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:56.452461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:56.453555 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:56.612141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:56.626833 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:56.627880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:56.628431 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:56.629321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:56.629587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-42bb5821-ff23-4613-85a1-c5db873056ec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1277 microversion: 2.20 time: 0.223546 May 09 20:24:56.630151 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:24:56 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:24:56.651894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:56.654004 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:56.655470 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:56.656192 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:56.661197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:56.665016 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:56.682434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:56.682893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:56.685115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:56.687453 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:57.236296 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:57.250196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-36d9edae-4314-41b5-9f01-873e8765c9b5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1299 microversion: 2.1 time: 0.598936 May 09 20:24:57.251134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 26/52] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:56 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1299 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:57.257152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:57.258920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:57.267723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:57.268482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:57.270244 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:57.270845 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:57.381122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:57.393623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-98e090f9-5616-4265-b6ca-d830f9cfb786 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1279 microversion: 2.1 time: 0.141218 May 09 20:24:57.400323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 27/53] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:57 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:57.418353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:57.422180 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:57.440122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:57.441170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:57.442912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:57.443364 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:57.444011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:57.451788 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2b222517-5202-4bd2-8dbd-e91f8e95e8de tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.828945 May 09 20:24:57.461692 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 27/54] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:56 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:24:57.612864 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:57.620355 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a63fd5ea-fb1f-42ca-b9e0-ffa53f4b81ae tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1296 microversion: 2.1 time: 0.211730 May 09 20:24:57.630929 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 28/55] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:57 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1296 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:57.650185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:57.653680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:57.662357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:57.669881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:57.673903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:57.674647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:57.837847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:57.848060 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:57.853133 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:57.860641 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7e3e6b76-f7a3-473d-aad8-d2aedb7a1fc9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1341 microversion: 2.20 time: 0.214167 May 09 20:24:57.861872 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 28/56] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:24:57 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1341 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:24:58.269882 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:58.271196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:58.284348 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.285425 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.286526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.287239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.416647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:58.417269 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:58.431710 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.432883 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.434502 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.435908 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.444655 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:58.453528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8db31803-ae94-4520-aac2-3485b640d65f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1299 microversion: 2.1 time: 0.188363 May 09 20:24:58.462169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 29/57] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:58 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:58.478294 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:58.479141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:58.494968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.495612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.503343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.503824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.607248 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:58.614635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-98d9bc9c-f496-47d7-898b-2c66d4174df2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1279 microversion: 2.1 time: 0.201572 May 09 20:24:58.624244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 29/58] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:58 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:58.646969 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:58.655834 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:58.663505 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.664161 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.665006 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:58.667362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:58.985711 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:58.997826 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4bf0507b-1203-4c82-a4c6-685e7c7e47db tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1296 microversion: 2.1 time: 0.360665 May 09 20:24:59.001227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 30/59] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:58 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1296 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:59.014368 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:59.015185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:59.019766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:59.040042 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-00ae91b3-a9ab-4a38-ae97-313d120a1d39 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.565714 May 09 20:24:59.040986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 30/60] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:58 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:24:59.046808 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:59.047312 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:59.048606 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:59.049055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:59.185087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:59.203523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:59.204736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:59.205896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-54610753-4b9c-4263-9b7f-b14408ef5006 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1339 microversion: 2.20 time: 0.202683 May 09 20:24:59.206451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 31/61] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:24:59 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:24:59.474325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:59.475327 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:59.494710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:59.499181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:59.502071 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:59.503267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:59.640434 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:24:59.642022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:24:59.651682 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:59.652871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:59.654022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:24:59.654556 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:24:59.799724 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:24:59.811007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-451a3037-a842-4507-8fef-fffd2c0c6096 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.342885 May 09 20:24:59.812330 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 31/62] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:59 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:00.017861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:00.018533 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:00.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.033852 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.034431 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.036051 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.092249 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:00.103581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0b353612-3e30-4a25-9e4e-13fe0e75a98a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.474856 May 09 20:25:00.114854 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 32/63] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:24:59 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:00.120138 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:00.121098 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:00.127909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.128709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.129864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.130546 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.310723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:00.326786 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9ac3b709-2663-4310-92b3-e40eebf7bd15 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.312848 May 09 20:25:00.327901 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 32/64] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:00 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:00.333813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:00.335157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:00.343186 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.343678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.344462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.347528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.529647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:00.543528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:00.556125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:00.558005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1aebb09c-86aa-4b76-bf13-67088ad18387 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.228714 May 09 20:25:00.560591 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 33/65] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:00 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:00.786636 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:00.794867 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-76893b30-6c83-4a2f-94cc-1c1493d487db tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.678711 May 09 20:25:00.795484 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 33/66] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:00 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:00.834688 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:00.835628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:00.854268 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.860551 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.861955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.862767 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.928016 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-c24227f6-63bb-4603-9023-8719a9f09cfa req-d1a66e5e-582c-4a68-a5fd-4f804602db44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a55e260a-09eb-4d67-9271-5fe7c21cab71", "tag": "acace666-a7e8-4fa0-a252-9fd85656a35c"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:00.947160 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c24227f6-63bb-4603-9023-8719a9f09cfa req-d1a66e5e-582c-4a68-a5fd-4f804602db44 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.948199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c24227f6-63bb-4603-9023-8719a9f09cfa req-d1a66e5e-582c-4a68-a5fd-4f804602db44 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.974749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-c24227f6-63bb-4603-9023-8719a9f09cfa req-d1a66e5e-582c-4a68-a5fd-4f804602db44 service nova] Creating event network-changed:acace666-a7e8-4fa0-a252-9fd85656a35c for instance a55e260a-09eb-4d67-9271-5fe7c21cab71 on hv-cinder-83699 May 09 20:25:00.975558 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c24227f6-63bb-4603-9023-8719a9f09cfa req-d1a66e5e-582c-4a68-a5fd-4f804602db44 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 20:25:00.976893 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd4e5a7-268f-4e02-a984-ae2368559999 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.977522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd4e5a7-268f-4e02-a984-ae2368559999 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.978906 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd4e5a7-268f-4e02-a984-ae2368559999 None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:00.983749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd4e5a7-268f-4e02-a984-ae2368559999 None None] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:00.994702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.compute.rpcapi [None req-2fd4e5a7-268f-4e02-a984-ae2368559999 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 20:25:00.995619 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd4e5a7-268f-4e02-a984-ae2368559999 None None] Releasing lock "compute-rpcapi-router" {{(pid=116849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 20:25:01.015964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2fd4e5a7-268f-4e02-a984-ae2368559999 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180872 May 09 20:25:01.016514 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 34/67] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:01.039519 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:01.048493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5f23f2e2-4de1-4536-9d5d-99d4d7c8a663 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.222809 May 09 20:25:01.049240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 34/68] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:00 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:01.125480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:01.126279 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:01.132639 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:01.133079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:01.133847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:01.134280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:01.343997 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:01.344903 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:01.351062 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:01.351781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:01.352744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:01.353397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:01.474180 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:01.487531 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-54814a28-70e7-46fe-b6d1-a1ba100cd2ba tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.368507 May 09 20:25:01.487531 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 35/69] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:01 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:01.578720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:01.579594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:01.599319 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:01.600056 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:01.601002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:01.601627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:02.011440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:02.022789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:02.024587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:02.025886 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f34878c8-7b44-4caa-ac18-4d93c3e034b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.451888 May 09 20:25:02.038747 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:01 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:02.045757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:02.047522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:02.057221 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:02.057911 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:02.059828 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:02.060433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:02.067448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:02.100555 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-17df70e0-72e0-423d-b06e-335c043a05b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.756333 May 09 20:25:02.102457 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 35/71] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:01 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:02.117865 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:02.118854 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:02.131115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:02.131843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:02.132738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:02.133456 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:02.456668 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:02.471754 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d8089c5c-3dd9-41ae-9b49-b777de5b39f5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.431314 May 09 20:25:02.472623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 37/72] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:02 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:02.502321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:02.503212 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:02.513527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:02.517368 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:02.518489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:02.519199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:02.630419 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:02.638896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f0cd5cf3-3267-4175-b43d-92516e832c8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.534796 May 09 20:25:02.639827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 36/73] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:02 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:03.047805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:03.050233 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:03.064930 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.065382 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.070884 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.071472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.414406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:03.423654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-95b0e26f-1523-4bb4-b6d4-d63b375aa185 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.925012 May 09 20:25:03.435772 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 38/74] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:02 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:03.441782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:03.443094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:03.464144 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.466441 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.470015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.471045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.706879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:03.729064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:03.729197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4e0ddca9-56ce-41b7-a03f-3cc6efa9357a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.277323 May 09 20:25:03.729765 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 39/75] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:03 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:03.744912 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:03.745511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:03.746567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:03.746767 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:03.747934 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-25dfe0e9-5663-42a2-a4ee-817702a30286 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.706990 May 09 20:25:03.748758 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 37/76] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:03 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:03.754735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.755471 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.756390 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.757148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.784469 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-35c6b702-61cd-46ce-b960-68db637e4c0e req-eb98eea1-6830-4e40-9302-b49a5f864172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5859d0-753a-4eb6-9c16-6a21b2a0758b", "tag": "8757cf9e-6828-4f88-b34e-3338c7176b27"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:03.794217 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-35c6b702-61cd-46ce-b960-68db637e4c0e req-eb98eea1-6830-4e40-9302-b49a5f864172 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.794658 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-35c6b702-61cd-46ce-b960-68db637e4c0e req-eb98eea1-6830-4e40-9302-b49a5f864172 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.829962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-35c6b702-61cd-46ce-b960-68db637e4c0e req-eb98eea1-6830-4e40-9302-b49a5f864172 service nova] Creating event network-changed:8757cf9e-6828-4f88-b34e-3338c7176b27 for instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b on hv-cinder-83699 May 09 20:25:03.841965 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-35c6b702-61cd-46ce-b960-68db637e4c0e req-eb98eea1-6830-4e40-9302-b49a5f864172 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092092 May 09 20:25:03.842560 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 38/77] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:03.851820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:03.859107 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:03.873277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.873949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:03.874881 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:03.875494 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.085882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:04.100810 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e5b2b3bd-ea24-41be-a858-37eef9b1df71 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.358488 May 09 20:25:04.101647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 40/78] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:03 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:04.196690 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-fc2440a2-6bf6-4230-a68f-69c58339bb78 req-ed5ff516-965f-4fb5-9b86-7a2c26660be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425e8732-2c2b-4c37-b2c3-e766712d293f", "tag": "9d1946fe-d370-43ff-a7d4-5a7d9c20d2be"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:04.216614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-fc2440a2-6bf6-4230-a68f-69c58339bb78 req-ed5ff516-965f-4fb5-9b86-7a2c26660be5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:04.217814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-fc2440a2-6bf6-4230-a68f-69c58339bb78 req-ed5ff516-965f-4fb5-9b86-7a2c26660be5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.254075 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-fc2440a2-6bf6-4230-a68f-69c58339bb78 req-ed5ff516-965f-4fb5-9b86-7a2c26660be5 service nova] Creating event network-changed:9d1946fe-d370-43ff-a7d4-5a7d9c20d2be for instance 425e8732-2c2b-4c37-b2c3-e766712d293f on hv-cinder-83699 May 09 20:25:04.267185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-fc2440a2-6bf6-4230-a68f-69c58339bb78 req-ed5ff516-965f-4fb5-9b86-7a2c26660be5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075209 May 09 20:25:04.271322 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 41/79] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:04.381644 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:04.398423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5b46296c-f2f0-45e3-92af-a0b39fab3ae9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.551752 May 09 20:25:04.401079 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 39/80] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:03 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:04.446423 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:04.447718 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:04.461730 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:04.462723 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.465762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:04.467291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.749028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:04.749958 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:04.769284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:04.769797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.775824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:04.781407 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.848707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:04.860942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b6fa52f7-aa71-4132-b227-d3e8c1a49cb3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.421421 May 09 20:25:04.861936 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 42/81] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:04 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:04.867097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:04.867887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:04.878157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:04.878661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.879843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:04.881331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:04.990984 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:05.002324 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e4f0a475-fc12-4c01-a6be-a9897e7ee23a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.259140 May 09 20:25:05.003145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 40/82] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:04 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:05.116953 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:05.121243 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:05.121827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:05.128863 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:05.129134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:05.130711 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:05.131106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:05.132131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:05.132575 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:05.133275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-04df5b8d-304a-4a2f-a394-3b1c7c4131a6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.270276 May 09 20:25:05.145801 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 43/83] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:04 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:05.362738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:05.373572 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fc373eed-dd3f-4392-9148-3801a7914d8f tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.257390 May 09 20:25:05.375438 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 41/84] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:05 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:05.416819 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:05.417502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:05.425557 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:05.426272 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:05.427246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:05.427911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:05.435387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-b78812aa-3df1-431f-8afc-2301f069e01b req-810a56ba-2364-46ac-9e7a-ad08a493bef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb02ec29-edbc-4126-beaf-29b18aa9557f", "name": "network-vif-plugged", "status": "completed", "tag": "78543ee9-a62c-4f54-bf13-c8bbb28f3c08"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:05.444331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b78812aa-3df1-431f-8afc-2301f069e01b req-810a56ba-2364-46ac-9e7a-ad08a493bef3 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:05.444998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b78812aa-3df1-431f-8afc-2301f069e01b req-810a56ba-2364-46ac-9e7a-ad08a493bef3 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:05.459218 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-b78812aa-3df1-431f-8afc-2301f069e01b req-810a56ba-2364-46ac-9e7a-ad08a493bef3 service nova] Creating event network-vif-plugged:78543ee9-a62c-4f54-bf13-c8bbb28f3c08 for instance bb02ec29-edbc-4126-beaf-29b18aa9557f on hv-cinder-83699 May 09 20:25:05.468083 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-b78812aa-3df1-431f-8afc-2301f069e01b req-810a56ba-2364-46ac-9e7a-ad08a493bef3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114551 May 09 20:25:05.470201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 44/85] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:25:05.879698 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:05.880722 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:05.894127 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:05.897718 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:05.899947 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:05.900561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:05.990172 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:06.003098 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8ab84df2-7a19-4bd8-ae74-d229201a97f7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.590373 May 09 20:25:06.004124 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 42/86] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:05 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:06.022124 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:06.023820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:06.046783 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:06.047623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:06.052031 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:06.052779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:06.328873 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:06.337148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a07a29c7-1f6b-4342-9fe9-66032303d460 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.462642 May 09 20:25:06.345603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 45/87] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:05 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:06.351619 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:06.352700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:06.365808 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:06.368023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:06.369494 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:06.369941 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:06.702843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:06.710787 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5a71a325-6916-484a-87b2-0d19ae57d03e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.694559 May 09 20:25:06.723824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 43/88] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:06 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:06.728610 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-3bcd2a00-465e-4e43-b7bc-c88a34451794 req-26ce3cc2-3468-431e-abd9-5739d2ffc787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbed4907-edef-46b3-a625-306d3f840aae", "tag": "830153c9-f6de-4238-b8ca-24ec8e070f82"}, {"name": "network-changed", "server_uuid": "5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6", "tag": "69ef2c60-07ae-4f03-b47c-0db178dcd214"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:06.747896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-3bcd2a00-465e-4e43-b7bc-c88a34451794 req-26ce3cc2-3468-431e-abd9-5739d2ffc787 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:06.748333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-3bcd2a00-465e-4e43-b7bc-c88a34451794 req-26ce3cc2-3468-431e-abd9-5739d2ffc787 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:06.761333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-3bcd2a00-465e-4e43-b7bc-c88a34451794 req-26ce3cc2-3468-431e-abd9-5739d2ffc787 service nova] Creating event network-changed:830153c9-f6de-4238-b8ca-24ec8e070f82 for instance fbed4907-edef-46b3-a625-306d3f840aae on hv-cinder-83699 May 09 20:25:06.762370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-3bcd2a00-465e-4e43-b7bc-c88a34451794 req-26ce3cc2-3468-431e-abd9-5739d2ffc787 service nova] Creating event network-changed:69ef2c60-07ae-4f03-b47c-0db178dcd214 for instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 on hv-cinder-83699 May 09 20:25:06.765955 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:06.775224 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:06.777063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:06.778427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-96a18000-1783-4c86-bbdd-093c8ac8bd8c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.431449 May 09 20:25:06.778992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 46/89] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:06 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:06.792457 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-3bcd2a00-465e-4e43-b7bc-c88a34451794 req-26ce3cc2-3468-431e-abd9-5739d2ffc787 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066483 May 09 20:25:06.794153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:06.794285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 44/90] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:06.795846 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:06.801706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:06.802226 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:06.803007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:06.803466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:06.970887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:06.981451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ae1912ad-debd-4534-b888-18816e9c633c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.199182 May 09 20:25:06.982328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 47/91] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:06 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:07.024953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:07.024953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:07.030822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.031375 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.032263 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.032765 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.175491 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:07.182840 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cbca2eb8-1393-40f3-b49e-af8bf01e3a90 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.165360 May 09 20:25:07.184073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 45/92] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:07 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:07.365309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:07.365938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:07.373313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.373792 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.374622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.375264 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.521024 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:07.529363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-28645cd5-8026-4fb9-bbcb-5bb51d82e92c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.170085 May 09 20:25:07.529958 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 48/93] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:07 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:07.730325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:07.730949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:07.737388 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.737835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.738609 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.739299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.797795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:07.798543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:07.810616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.810616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.810616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:07.810616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:07.884033 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:07.894079 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d37b3933-fd71-4070-b7a4-38af9af28d4a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.168236 May 09 20:25:07.894837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 46/94] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:07 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:07.960315 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:07.969053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:07.970537 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:07.971678 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9cdb9cc0-cba1-4131-82f1-df4d0523ba68 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.178900 May 09 20:25:07.972384 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 49/95] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:07 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:07.999261 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:08.000175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:08.006246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.006681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.007497 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.007932 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.139987 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:08.147229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f56b8975-989a-4b2d-ab19-90f69f503277 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.152333 May 09 20:25:08.147813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 47/96] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:07 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:08.200876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:08.201602 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:08.207499 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.208015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.208858 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.209362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.378205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:08.385629 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6a183e12-1a83-47b1-a3ec-603cd06ba12b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.188604 May 09 20:25:08.386199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 50/97] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:08 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:08.546409 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:08.547119 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:08.553283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.553825 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.555231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.555777 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.697672 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:08.705625 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-72c06d57-59fb-4eea-aa67-9f70ee20426c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.163270 May 09 20:25:08.706184 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 48/98] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:08 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:08.912699 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:08.913432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:08.920303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.921063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.922108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:08.922736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:08.990872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:08.991907 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:08.998851 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.001241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.004956 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.006803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.185307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:09.194163 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d6d921ec-8207-4a6d-936f-d6810ca28c27 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.285228 May 09 20:25:09.194842 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 51/99] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:08 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:09.225815 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:09.226451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:09.236905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.237683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.238740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.239376 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.352327 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:09.361528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:09.363421 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:09.364587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-77b4daf7-3031-4764-97e6-b2c22151467e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.377749 May 09 20:25:09.365139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 49/100] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:08 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:09.370035 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-c4c99ca5-04a9-492e-a905-a25c2e0528e8 req-61f75d20-5a50-4738-b443-4ce4901cbfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a55e260a-09eb-4d67-9271-5fe7c21cab71", "name": "network-vif-plugged", "status": "completed", "tag": "acace666-a7e8-4fa0-a252-9fd85656a35c"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:09.381329 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-c4c99ca5-04a9-492e-a905-a25c2e0528e8 req-61f75d20-5a50-4738-b443-4ce4901cbfb8 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.381776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-c4c99ca5-04a9-492e-a905-a25c2e0528e8 req-61f75d20-5a50-4738-b443-4ce4901cbfb8 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.394519 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-c4c99ca5-04a9-492e-a905-a25c2e0528e8 req-61f75d20-5a50-4738-b443-4ce4901cbfb8 service nova] Creating event network-vif-plugged:acace666-a7e8-4fa0-a252-9fd85656a35c for instance a55e260a-09eb-4d67-9271-5fe7c21cab71 on hv-cinder-83699 May 09 20:25:09.400115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-c4c99ca5-04a9-492e-a905-a25c2e0528e8 req-61f75d20-5a50-4738-b443-4ce4901cbfb8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 May 09 20:25:09.400617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 50/101] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:09.407227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:09.407982 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:09.414244 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.414872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.415667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.416276 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.432069 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:09.439994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-207f1df1-8214-48d7-b605-af43614dfd91 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.218336 May 09 20:25:09.440932 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 52/102] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:09 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:09.557813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:09.566100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-678eff1a-be94-4d2e-9729-4f535f57e8c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.164128 May 09 20:25:09.566673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 51/103] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:09 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:09.721961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:09.722569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:09.728513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.728903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.729669 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:09.730152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:09.867230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:09.876091 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f6e6c335-adad-48a0-a000-08ad1bc84b66 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.158029 May 09 20:25:09.876678 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 53/104] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:09 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:10.211023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:10.212186 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:10.222418 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.222878 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.223697 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.224290 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.373363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:10.382650 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ab6a7411-05b0-4e19-949d-58a96c657781 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.175546 May 09 20:25:10.383220 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 52/105] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:10 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:10.384425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:10.385572 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:10.392910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.393538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.394364 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.394919 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.457503 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:10.458153 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:10.465544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.465988 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.466836 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.467972 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.546930 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:10.560223 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:10.561836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:10.563093 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5ce468c9-406a-4cfb-a00b-027f2e27fe3f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.183581 May 09 20:25:10.563789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 54/106] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:10 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:10.583988 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:10.584761 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:10.592644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.593432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.594417 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.594933 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.627761 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:10.641116 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c3611725-886d-482f-9349-dafeca5b6df5 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1314 microversion: 2.1 time: 0.187547 May 09 20:25:10.641867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 53/107] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:10 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:10.760599 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:10.770763 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-08372d62-c725-4a55-a647-3ae4f2d32a87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.191081 May 09 20:25:10.779860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 55/108] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:10 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:10.895480 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:10.896094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:10.902216 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.902974 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:10.903989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:10.904725 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.088438 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:11.099261 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-39e5e7d3-c008-4b30-a1b7-2a896130f7d5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.206514 May 09 20:25:11.099922 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 54/109] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:10 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:11.401810 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:11.404350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:11.426433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.430493 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.434303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.435939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.581612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:11.582157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:11.589877 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.590305 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.591076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.591630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.657111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:11.665259 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ceb28c10-75b3-41d3-900b-8cd865ff13f4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.268341 May 09 20:25:11.676210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 56/110] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:11 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:11.681000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:11.681662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:11.689331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.689780 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.690621 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.691064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.797131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:11.819549 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:11.822746 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:11.827300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0beedc9e-d3f6-4470-88cf-1d9df098d62c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.246641 May 09 20:25:11.828702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 55/111] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:11 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:11.844235 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:11.846202 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:11.854116 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.854773 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.856425 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:11.869266 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:11.940061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:11.951768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6975f1e5-9516-47ca-a3c1-61af1790bb79 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1499 microversion: 2.1 time: 0.273069 May 09 20:25:11.955850 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 57/112] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:11 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1499 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:12.122918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:12.123673 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:12.138942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:12.141573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:12.142737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:12.144465 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:12.394187 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:12.403388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f7d342f9-9305-4645-9496-38a728701703 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.289282 May 09 20:25:12.407215 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 58/113] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:12 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:12.682849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:12.687000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:12.698621 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:12.699963 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:12.701929 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:12.702772 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:12.754398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:12.784125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d6bd91af-fe92-4d8f-b05e-e4ecebcb9863 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.953868 May 09 20:25:12.795239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 56/114] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:11 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:12.845896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:12.846521 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:12.852963 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:12.853407 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:12.854166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:12.854595 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:12.878905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:12.889948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0f6ba9e3-461d-4c94-b47f-a6f8bc941161 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.210872 May 09 20:25:12.899674 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 59/115] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:12 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:12.991047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:12.998814 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:13.000335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:13.001427 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-51cd9a57-e461-4498-803c-9a68b112f380 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.159400 May 09 20:25:13.001992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 57/116] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:12 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:13.392964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-e0ca3f9f-7938-4ab1-a87a-03eaf7e62314 req-b2bca5b7-a64a-4555-90d0-2e8e7c7a803b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6", "name": "network-vif-plugged", "status": "completed", "tag": "69ef2c60-07ae-4f03-b47c-0db178dcd214"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:13.401213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-e0ca3f9f-7938-4ab1-a87a-03eaf7e62314 req-b2bca5b7-a64a-4555-90d0-2e8e7c7a803b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:13.401676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-e0ca3f9f-7938-4ab1-a87a-03eaf7e62314 req-b2bca5b7-a64a-4555-90d0-2e8e7c7a803b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:13.424275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:13.424883 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:13.428225 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-e0ca3f9f-7938-4ab1-a87a-03eaf7e62314 req-b2bca5b7-a64a-4555-90d0-2e8e7c7a803b service nova] Creating event network-vif-plugged:69ef2c60-07ae-4f03-b47c-0db178dcd214 for instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 on hv-cinder-83699 May 09 20:25:13.433945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-e0ca3f9f-7938-4ab1-a87a-03eaf7e62314 req-b2bca5b7-a64a-4555-90d0-2e8e7c7a803b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045304 May 09 20:25:13.435650 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 60/117] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:13.438028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:13.438344 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:13.439143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:13.439599 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:13.609899 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:13.617775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8d5550d6-2342-4559-87ec-d0224c2ec611 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.197365 May 09 20:25:13.623980 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 58/118] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:13 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:13.806473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:13.806473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:13.812403 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:13.812922 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:13.813855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:13.814413 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:13.906003 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:13.906595 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:13.914957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:13.914957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:13.919959 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:13.920380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:13.980638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:13.988303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1d83b854-a39f-4035-a435-6af4279d347f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.189816 May 09 20:25:13.988882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 61/119] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:13 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:14.020602 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:14.021880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:14.028545 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:14.029238 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:14.030202 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:14.031528 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:14.082086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:14.093693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-32a6fe82-962f-4801-9a02-fc53df47c54b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.191354 May 09 20:25:14.094617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 59/120] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:13 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:14.206457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:14.214207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:14.216410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:14.217516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0e9028cd-78f6-42ab-b5d4-6e8135866597 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.201031 May 09 20:25:14.218078 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 62/121] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:14 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:14.634656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:14.635262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:14.641963 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:14.642422 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:14.643220 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:14.643689 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:14.781202 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:14.788427 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c4cac5d1-ec12-4253-bc7f-9ffe949761fd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.157583 May 09 20:25:14.789047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 60/122] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:14 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:15.005830 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:15.006524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:15.012783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.013303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.014127 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.014637 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.110742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:15.111362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:15.117178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.117623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.118452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.118820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.146210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:15.154245 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-14a52c2b-32b9-44c9-81a8-71a2045a0333 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.151958 May 09 20:25:15.155266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 63/123] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:15 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:15.236257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:15.236993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:15.243061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.243868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.244790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.245427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.260693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:15.268199 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1db5529e-12ad-4d78-b2b1-7f04f5975c0c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.161176 May 09 20:25:15.275748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 61/124] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:15 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:15.380268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:15.388284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:15.389772 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:15.390948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-79b73473-0ef0-4fb0-b263-1b4f373f5c80 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.158570 May 09 20:25:15.391539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 64/125] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:15 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:15.806283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:15.807128 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:15.813729 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.814177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.815008 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:15.815457 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:15.951254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:15.958461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-95e25f7b-bc66-450f-8f8b-d9e53957879c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.156144 May 09 20:25:15.959026 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 62/126] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:15 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:16.171861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:16.172400 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:16.178197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.178638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:16.179440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.179877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:16.286056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:16.286845 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:16.294428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.294964 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:16.295876 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.296412 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:16.326591 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:16.334283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d4f73179-970b-4f26-a394-0972888b3b3d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.166481 May 09 20:25:16.335034 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 65/127] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:16 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:16.408268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:16.409395 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:16.414942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.415387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:16.416176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.416653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:16.437879 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:16.445494 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ccb9c7df-eee3-4d0c-bb8e-6be39050573d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.163887 May 09 20:25:16.446065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 63/128] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:16 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:16.552035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:16.560797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:16.562392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:16.563751 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fffad4b5-f549-4624-9c1f-3c86f0a6a9e2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.159248 May 09 20:25:16.564327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 66/129] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:16 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:16.976185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:16.977267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:16.984331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.984904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:16.985556 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:16.985989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:17.133362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:17.141382 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-125cd41d-582b-4422-a30b-8f7125f80df0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.169058 May 09 20:25:17.142019 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 64/130] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:16 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:17.352065 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:17.352707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:17.359607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:17.360093 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:17.360870 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:17.361308 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:17.463128 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:17.463779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:17.470521 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:17.470969 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:17.471760 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:17.472232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:17.496065 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:17.503791 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a1fe5918-5d14-463f-86d0-3e3cf80610b2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.155930 May 09 20:25:17.504438 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 67/131] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:17 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:17.582321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:17.583881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:17.596589 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:17.597264 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:17.598600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:17.599220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:17.631181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:17.639837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d852b1f6-c822-4d35-9f76-ae53893f0978 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.181172 May 09 20:25:17.640409 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 65/132] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:17 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:17.743848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:17.751777 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:17.753201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:17.754302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-09c72117-4fc7-49cc-8d84-d7921db6f300 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.175812 May 09 20:25:17.754871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 68/133] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:17 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:18.158834 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:18.159494 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:18.165648 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.166101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.166866 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.167300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.305160 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:18.313374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-039fedb3-5161-4410-aed9-8034d9cd2089 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.158285 May 09 20:25:18.313793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 66/134] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:18 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:18.521056 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:18.521673 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:18.527696 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.528141 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.528887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.529312 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.657052 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:18.657661 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:18.658078 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:18.663539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.663982 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.664734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.665156 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.665255 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a4a753e5-3e26-4608-9456-e77cafe96758 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.147901 May 09 20:25:18.665705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 69/135] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:18 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:18.774062 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:18.774679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:18.781081 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.781529 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.782297 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.782726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.798304 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:18.805865 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9c8d456e-4d02-41b8-a94b-2e1f1eb13730 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.152517 May 09 20:25:18.806436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 67/136] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:18 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:18.811656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ac66431a-54f7-432c-a3ee-bf86e84c9736 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af1aedd9-19a8-4524-88db-c038adac6c4d"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:18.813088 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ac66431a-54f7-432c-a3ee-bf86e84c9736 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:18.819071 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac66431a-54f7-432c-a3ee-bf86e84c9736 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.819619 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac66431a-54f7-432c-a3ee-bf86e84c9736 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.820438 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac66431a-54f7-432c-a3ee-bf86e84c9736 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:18.820956 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac66431a-54f7-432c-a3ee-bf86e84c9736 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:18.925332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:18.933960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:18.935504 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:18.936939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2fc91d5b-7767-4a8b-aa51-9194ccdaeb0f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.166744 May 09 20:25:18.937580 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 70/137] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:18 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:19.330442 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:19.331217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:19.337231 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.337674 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:19.338453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.338882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:19.471768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:19.478900 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4e666254-8b27-41ce-acf3-938151294d84 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.152489 May 09 20:25:19.479481 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 71/138] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:19 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:19.683619 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:19.684234 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:19.690242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.690688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:19.691463 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.691893 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:19.819372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:19.827566 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6ac5604f-b7eb-40d0-a881-4c53fec4280b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.147947 May 09 20:25:19.828129 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 72/139] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:19 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:19.832495 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:19.833105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:19.838455 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.838975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:19.840902 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.841341 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:19.976438 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:19.983762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1b5bc637-803e-4f2d-91b2-f6f1e1d417d4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.154663 May 09 20:25:19.984314 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 73/140] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:19 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:19.988594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:19.989212 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:19.994864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.995302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:19.996724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:19.997150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:20.127248 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:20.134938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:20.136852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:20.137949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5f62b4b6-eafa-4df5-b62c-5b17a78ac283 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.152737 May 09 20:25:20.138502 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 74/141] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:19 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:20.496303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:20.496915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:20.503073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:20.503551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:20.504304 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:20.504736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:20.631818 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:20.639757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-86857b13-e344-4454-b1a7-ee80b33a8317 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.147192 May 09 20:25:20.640332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 75/142] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:20 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:20.844741 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:20.845356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:20.851553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:20.852002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:20.852791 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:20.853243 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:21.002816 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:21.010392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8fd3e976-42b1-4ca5-b420-c385772136a1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.169618 May 09 20:25:21.011736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 76/143] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:20 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:21.016471 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:21.017099 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:21.022694 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:21.023135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:21.024057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:21.024489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:21.154015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:21.161369 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6dadaf15-ad44-4c15-b2be-310b1fd9bf3f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.148589 May 09 20:25:21.162029 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 77/144] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:21 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:21.166622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:21.167262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:21.172986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:21.173436 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:21.174193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:21.174622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:21.304993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:21.313826 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:21.315309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:21.316438 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4a2a6672-8825-4f62-8f59-28c1bdad64c8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.153443 May 09 20:25:21.317000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 78/145] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:21 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:21.656273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:21.656882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:21.663155 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:21.663627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:21.664394 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:21.664821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:21.794664 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:21.801904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1b0800ec-aaf7-4fb9-a61c-9df76a52db43 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.149519 May 09 20:25:21.802459 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 79/146] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:21 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:22.029647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:22.030447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:22.037117 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.037651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:22.038697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.039328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:22.173711 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:22.180932 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f3e8558f-fe8e-46d0-b4e0-f047e8cc4fb4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.156467 May 09 20:25:22.181476 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 80/147] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:22 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:22.185843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:22.186435 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:22.192076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.192515 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:22.193291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.193716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:22.319714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:22.327541 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-dc15be29-60af-4601-8589-d3b9637a468b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.145106 May 09 20:25:22.328094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 81/148] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:22 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:22.335575 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:22.336182 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:22.343205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.343680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:22.344445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.344876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:22.478589 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:22.486475 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:22.488006 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:22.489125 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fc291754-b7d8-4561-ad3b-7344fda7ed6a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.157667 May 09 20:25:22.489674 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 82/149] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:22 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:22.819324 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:22.819954 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:22.826183 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.826628 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:22.827423 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:22.827892 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:23.136063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:23.144564 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6d5c3ccb-0a3c-47aa-9ee6-2e8ec29ce5e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.328995 May 09 20:25:23.145180 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 83/150] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:22 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:23.197881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:23.198604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:23.204724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:23.205158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:23.205944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:23.206366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:23.335783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:23.343175 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2005b2cc-1315-4bdf-8cd6-21b0889c7ac9 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.149049 May 09 20:25:23.343759 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 84/151] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:23 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:23.348161 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:23.348819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:23.354215 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:23.355153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:23.355934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:23.356360 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:23.493869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:23.501769 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9871b3ba-cfbd-46cc-839c-fe5231b39752 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.157025 May 09 20:25:23.502481 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 85/152] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:23 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:23.506829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:23.507444 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:23.513439 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:23.513881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:23.514625 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:23.515054 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:23.643224 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:23.651049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:23.653507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:23.654635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-bd10dd19-aed2-4c11-9e1a-fd44b5ca43eb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.151240 May 09 20:25:23.655191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 86/153] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:23 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:24.162164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:24.162641 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:24.170185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.170505 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.171332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.171745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.316561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:24.324820 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7648f04d-a75a-4711-8528-8ce4dcf7389a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.166823 May 09 20:25:24.325468 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 87/154] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:24 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:24.359915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:24.360525 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:24.366270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.366702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.367477 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.367903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.503501 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:24.512553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-580539b4-64ca-4410-b38b-d8bae192550d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.156284 May 09 20:25:24.513140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 88/155] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:24 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:24.518079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:24.518676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:24.524502 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.524939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.525709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.526131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.655702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:24.664379 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6fd319da-943f-4fa0-9ea1-82bd98d667c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.149906 May 09 20:25:24.665164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 89/156] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:24 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:24.683007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:24.683861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:24.691317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.691868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.692655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.693149 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.846006 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:24.861739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:24.863988 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:24.865606 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-29b13822-73a6-4ab7-b831-766f5d704c30 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.189658 May 09 20:25:24.876418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 90/157] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:24 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:24.876418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-48d639f1-f084-44b1-a96f-ed17ba47cd2f req-8341fc52-4972-4ce5-b905-cf32ef8317af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbed4907-edef-46b3-a625-306d3f840aae", "name": "network-vif-plugged", "status": "completed", "tag": "830153c9-f6de-4238-b8ca-24ec8e070f82"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:24.883454 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-48d639f1-f084-44b1-a96f-ed17ba47cd2f req-8341fc52-4972-4ce5-b905-cf32ef8317af service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:24.884091 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-48d639f1-f084-44b1-a96f-ed17ba47cd2f req-8341fc52-4972-4ce5-b905-cf32ef8317af service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:24.898702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-48d639f1-f084-44b1-a96f-ed17ba47cd2f req-8341fc52-4972-4ce5-b905-cf32ef8317af service nova] Creating event network-vif-plugged:830153c9-f6de-4238-b8ca-24ec8e070f82 for instance fbed4907-edef-46b3-a625-306d3f840aae on hv-cinder-83699 May 09 20:25:24.904686 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-48d639f1-f084-44b1-a96f-ed17ba47cd2f req-8341fc52-4972-4ce5-b905-cf32ef8317af service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036379 May 09 20:25:24.906562 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 91/158] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:25.342175 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:25.343920 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:25.350891 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.351604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:25.352572 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.353200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:25.512323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:25.529914 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-431dff05-a026-4507-9f54-db386ac353cc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.192400 May 09 20:25:25.532245 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 92/159] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:25 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:25.537227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:25.538357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:25.552964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.555625 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:25.556892 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.557490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:25.704530 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:25.718181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9de8d7a8-65f4-441a-a344-629bee71a6e5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.184565 May 09 20:25:25.718771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 93/160] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:25 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:25.723175 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:25.723826 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:25.731424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.731878 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:25.732651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.733080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:25.915742 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:25.925251 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a28184d7-f492-4e2c-afc2-57a1f6a973a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.205439 May 09 20:25:25.925827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 94/161] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:25 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:25.931189 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:25.931994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:25.937676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.938121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:25.938881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:25.939304 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:26.101219 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:26.110497 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:26.112028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:26.113345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e4400cb8-fde0-47cf-92ae-4f1f769c70ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.186020 May 09 20:25:26.113901 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 95/162] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:25 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:26.554375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:26.555735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:26.562717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:26.563242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:26.564096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:26.564674 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:26.710718 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:26.719168 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a61d8716-c64b-45d1-9c5a-bf1cf501032c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.174406 May 09 20:25:26.736736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 96/163] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:26 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:26.742019 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:26.742626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:26.749751 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:26.750200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:26.750965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:26.751420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:26.899862 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:26.909634 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4a73fc18-214f-469d-9427-bbd8b95941de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.171295 May 09 20:25:26.910212 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 97/164] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:26 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:26.942729 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:26.943569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:26.950889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:26.951336 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:26.952128 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:26.952553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:27.112925 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:27.121294 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-05d1513a-1609-47a6-aa6c-38658c795774 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.182042 May 09 20:25:27.122181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 98/165] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:26 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:27.132543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:27.133151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:27.139591 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:27.140031 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:27.140785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:27.141211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:27.284568 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:27.293687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:27.295272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:27.296580 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a087a6cb-d147-41b0-912b-dd73c486bff1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.167732 May 09 20:25:27.297118 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 99/166] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:27 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:27.740309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:27.740995 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:27.748042 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:27.748553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:27.749383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:27.749877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:27.886380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:27.895096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0207fce0-ab32-4f24-bb98-e0a4381947e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.158695 May 09 20:25:27.896012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 100/167] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:27 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:27.926244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:27.926854 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:27.933769 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:27.934211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:27.935005 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:27.935436 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:28.067285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:28.076186 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7945da92-ade3-44c0-b636-00d84edc38bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.153981 May 09 20:25:28.076899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 101/168] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:27 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:28.139621 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:28.140232 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:28.145949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:28.146392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:28.147148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:28.147720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:28.293280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:28.303307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9870e5c6-3d08-4cc1-8b09-8926337daa8e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.167601 May 09 20:25:28.303831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 102/169] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:28 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:28.318432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:28.319039 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:28.325135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:28.325580 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:28.326342 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:28.326770 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:28.476847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:28.488140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:28.489717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:28.490944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8bd57879-a45c-4410-b174-52a180b23956 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.176167 May 09 20:25:28.491496 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 103/170] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:28 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:28.847841 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-036e5f84-bf7b-4a82-a7e0-1625a515ed20 req-2a7b7455-1b7d-43db-95cd-89276a840acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425e8732-2c2b-4c37-b2c3-e766712d293f", "name": "network-vif-plugged", "status": "completed", "tag": "9d1946fe-d370-43ff-a7d4-5a7d9c20d2be"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:28.856938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-036e5f84-bf7b-4a82-a7e0-1625a515ed20 req-2a7b7455-1b7d-43db-95cd-89276a840acf service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:28.857526 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-036e5f84-bf7b-4a82-a7e0-1625a515ed20 req-2a7b7455-1b7d-43db-95cd-89276a840acf service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:28.876243 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-036e5f84-bf7b-4a82-a7e0-1625a515ed20 req-2a7b7455-1b7d-43db-95cd-89276a840acf service nova] Creating event network-vif-plugged:9d1946fe-d370-43ff-a7d4-5a7d9c20d2be for instance 425e8732-2c2b-4c37-b2c3-e766712d293f on hv-cinder-83699 May 09 20:25:28.881669 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-036e5f84-bf7b-4a82-a7e0-1625a515ed20 req-2a7b7455-1b7d-43db-95cd-89276a840acf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037505 May 09 20:25:28.882548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 104/171] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:25:28.912688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:28.913674 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:28.923626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:28.924185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:28.925029 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:28.925836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:29.084622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:29.095423 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fabec616-64d1-4d98-bd5f-1d073c9298da tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.187011 May 09 20:25:29.096030 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 105/172] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:28 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:29.110058 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:29.110668 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:29.120198 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:29.127867 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:29.129029 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:29.130213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:29.405793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ac66431a-54f7-432c-a3ee-bf86e84c9736 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "POST /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.597334 May 09 20:25:29.407459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 68/173] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:25:18 2022] POST /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f/os-volume_attachments => generated 194 bytes in 10600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:29.429241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:29.430175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:29.444140 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:29.444674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:29.445830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:29.446827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:29.468291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:29.479923 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e2e4a3e5-3b12-47f1-afd0-4150039adef4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.373300 May 09 20:25:29.480774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 106/174] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:29 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:29.519022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:29.519703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:29.539626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:29.540081 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:29.540877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:29.541318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:29.772784 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:29.781687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c0b1f71b-95ec-4b88-9698-5342ca334a69 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.372742 May 09 20:25:29.782943 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 69/175] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:29 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:29.795970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:29.805686 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:29.808393 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:29.810226 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-11d6b347-ec53-4efd-833a-6255c1f59f81 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.302869 May 09 20:25:29.810934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 107/176] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:29 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:30.113121 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:30.113732 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:30.119910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.120830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.121652 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.122032 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.298558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:30.305787 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3d885db0-0452-4d43-96fe-ac898c6dda42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.196530 May 09 20:25:30.306368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 70/177] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:30 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:30.497885 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:30.498643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:30.505170 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.505846 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.506622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.507061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.645403 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:30.653708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-deaae7d3-6698-48aa-b8a5-1838db98a3d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.160546 May 09 20:25:30.654258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 108/178] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:30 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:30.799639 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:30.800923 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:30.806887 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.807343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.808544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.809009 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.829154 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:30.830061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:30.836373 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.837197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.838293 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:30.839828 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:30.974214 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:30.982968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3227a6cb-12a8-493f-acc7-0b966b20512f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.187197 May 09 20:25:30.984366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 71/179] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:30 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:31.035786 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:31.046746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:31.048550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:31.049807 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-945f7dd4-be0e-4ff1-a3e1-e8ce691288d3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.224852 May 09 20:25:31.050612 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 109/180] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:30 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:31.321983 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:31.322596 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:31.329388 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:31.329835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:31.330595 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:31.331030 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:31.467510 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:31.475238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b8b9f18d-f05e-4528-b0cd-2fbad69bb7a4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.157004 May 09 20:25:31.476148 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 72/181] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:31 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:31.669600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:31.670200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:31.676302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:31.676747 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:31.677506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:31.677933 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:31.807253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:31.814882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-faafdbf8-de13-474f-8fd2-2672d5f3d987 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.149274 May 09 20:25:31.815454 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 110/182] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:31 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:32.001201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:32.001814 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:32.008051 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.008438 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.009197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.009630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.068881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:32.069661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:32.075780 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.076252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.077005 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.077431 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.137534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:32.145486 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2e78a612-2987-41f3-9b74-a343fda8720e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.148052 May 09 20:25:32.146060 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 73/183] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:31 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:32.211182 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:32.219388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:32.221007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:32.222227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fd627244-efac-4182-b961-0639fe3bf992 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.157245 May 09 20:25:32.222854 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 111/184] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:32 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:32.492948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:32.493614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:32.501610 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.502055 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.502816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.503245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.631104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:32.638778 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d54b28f6-359d-4c60-815f-73adc621e98b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.150671 May 09 20:25:32.639352 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 74/185] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:32 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:32.832266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:32.832784 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:32.838736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.840363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.841132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:32.841573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:32.971126 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:32.978323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f63d2982-c0a3-4adb-8eef-aba8a933c13b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.149936 May 09 20:25:32.978876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 112/186] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:32 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:33.162246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:33.162886 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:33.168810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:33.169256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:33.170011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:33.170452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:33.240159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:33.240880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:33.247949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:33.248365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:33.249277 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:33.249771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:33.300157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:33.307293 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f7b51adb-2fd1-4850-abdd-a63e76830f45 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.148954 May 09 20:25:33.308665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 75/187] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:33 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:33.381754 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:33.396220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:33.396220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:33.396519 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-252060fb-6e3c-4ce4-818a-43c3e836dc6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.160232 May 09 20:25:33.397060 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 113/188] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:33 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:33.655733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:33.656279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:33.662531 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:33.662980 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:33.663765 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:33.664229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:33.793874 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:33.801000 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5def41ce-55b7-4765-801c-cf379d7bbb2f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.149463 May 09 20:25:33.801559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 76/189] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:33 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:33.995524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:33.996136 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:34.002017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.002456 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.003208 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.003660 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.130306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:34.138354 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-06a05dbc-c2d7-436d-9bc5-e5aba0970767 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.146734 May 09 20:25:34.138922 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 114/190] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:33 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:34.325625 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:34.326131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:34.332028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.332476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.333236 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.333667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.414458 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:34.415058 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:34.421247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.421681 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.422431 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.422855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.459111 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:34.467381 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5ce45ef9-5908-4f47-86cf-7795f2b3b72a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.146225 May 09 20:25:34.468780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 77/191] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:34 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:34.552511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:34.560892 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:34.562378 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:34.563499 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f3be91bb-2a25-4743-9aa7-3cf81946ac23 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.152808 May 09 20:25:34.564083 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 115/192] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:34 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:34.818118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:34.818728 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:34.825805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.826249 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.827008 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:34.827479 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:34.956298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:34.963448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-73fd2cb7-0b13-40b9-b51e-22fc43a55e16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.149233 May 09 20:25:34.964030 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 78/193] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:34 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:35.154834 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:35.155380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:35.161129 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.161570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:35.162323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.162749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:35.288128 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:35.296344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-79d89571-6541-4c7c-b606-53a2aaad00d1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.145463 May 09 20:25:35.296904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 116/194] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:35 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:35.484676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:35.485290 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:35.491003 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.491478 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:35.492238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.492664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:35.584707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:35.585316 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:35.593409 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.593885 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:35.594662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.595098 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:35.617746 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:35.626257 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a50ebd39-f7cd-4f4f-b255-a2bb4dae5d9c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.145379 May 09 20:25:35.626864 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 79/195] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:35 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:35.743355 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:35.751061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:35.752587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:35.753678 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1ac7306d-61dc-4fc9-a2a3-96b6bdf585d4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.172903 May 09 20:25:35.754229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 117/196] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:35 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:35.980281 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:35.980937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:35.987488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.987936 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:35.988707 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:35.989145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:36.122237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:36.129767 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-000c633a-e336-4c81-9599-5c53bf2b3342 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.153542 May 09 20:25:36.130339 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 80/197] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:35 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:36.312840 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:36.313526 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:36.319268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:36.319802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:36.320647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:36.321073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:36.462862 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:36.471148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3c6a63ed-053b-47c6-af77-3008d4839520 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.162021 May 09 20:25:36.472854 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 118/198] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:36 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:36.644008 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:36.644621 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:36.650465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:36.650909 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:36.651794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:36.652274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:36.772927 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:36.773527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:36.778486 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:36.779834 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:36.780259 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:36.781020 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:36.781443 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:36.786753 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-65257080-1e4e-4818-81ac-a1d59c4b6e91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.146689 May 09 20:25:36.787318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 81/199] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:36 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:36.912925 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:36.921560 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:36.923114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:36.924289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c68f54d2-bcc9-40e4-bc17-86962744d5a3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.155192 May 09 20:25:36.924881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 119/200] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:36 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:25:37.146786 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:37.147314 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:37.154169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.154618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.155382 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.155842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.286397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:37.293630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cd2aded3-1680-4609-b3c8-86d36f26b230 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.150857 May 09 20:25:37.294192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 82/201] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:37 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:37.488797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:37.489408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:37.495347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.495816 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.496571 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.497005 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.633719 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:37.641806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9451497c-7b2c-4ef1-91ac-37db2eed928c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1367 microversion: 2.1 time: 0.156816 May 09 20:25:37.642724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 120/202] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:37 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:37.812086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:37.812709 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:37.818759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.819209 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.820181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.820489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.943500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:37.954731 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:37.962242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.962688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.963482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:37.963969 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:37.968135 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:37.975986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3ef4722d-7015-44e3-89d3-e3cd608b67c1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.168752 May 09 20:25:37.976375 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 83/203] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:37 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:38.099607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:38.107897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:38.109382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:38.110487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-66ca6ecc-1c11-41ea-9758-2718913df44e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1407 microversion: 2.20 time: 0.172234 May 09 20:25:38.111041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 121/204] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:37 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:38.256557 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-2a911da5-88c7-4a0d-90e6-229ce262f311 req-f2bab175-a7f2-4d89-b7d9-f18414defd3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5859d0-753a-4eb6-9c16-6a21b2a0758b", "name": "network-vif-plugged", "status": "completed", "tag": "8757cf9e-6828-4f88-b34e-3338c7176b27"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:38.265690 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-2a911da5-88c7-4a0d-90e6-229ce262f311 req-f2bab175-a7f2-4d89-b7d9-f18414defd3b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:38.266409 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-2a911da5-88c7-4a0d-90e6-229ce262f311 req-f2bab175-a7f2-4d89-b7d9-f18414defd3b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:38.289180 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-2a911da5-88c7-4a0d-90e6-229ce262f311 req-f2bab175-a7f2-4d89-b7d9-f18414defd3b service nova] Creating event network-vif-plugged:8757cf9e-6828-4f88-b34e-3338c7176b27 for instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b on hv-cinder-83699 May 09 20:25:38.296641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-2a911da5-88c7-4a0d-90e6-229ce262f311 req-f2bab175-a7f2-4d89-b7d9-f18414defd3b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043707 May 09 20:25:38.297745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 84/205] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:25:38.311461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:38.312026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:38.320268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:38.321310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:38.322420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:38.323179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:38.501280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:38.508745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-bda32c59-db4d-438c-ba6b-a4ecbc1e51cb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1321 microversion: 2.1 time: 0.202327 May 09 20:25:38.509299 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 122/206] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:38 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:38.659977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:38.660676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:38.667524 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:38.668021 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:38.668779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:38.669209 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:38.798927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:38.806398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-976a123b-afd8-4285-8134-1f7191422324 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1557 microversion: 2.1 time: 0.150673 May 09 20:25:38.806962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 85/207] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:38 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:38.823816 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1c964473-dc0e-4b8b-b3e4-3988693e8b93 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:38.824392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1c964473-dc0e-4b8b-b3e4-3988693e8b93 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:38.830201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c964473-dc0e-4b8b-b3e4-3988693e8b93 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:38.830646 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c964473-dc0e-4b8b-b3e4-3988693e8b93 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:38.831414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c964473-dc0e-4b8b-b3e4-3988693e8b93 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:38.831860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c964473-dc0e-4b8b-b3e4-3988693e8b93 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:38.961736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1c964473-dc0e-4b8b-b3e4-3988693e8b93 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142284 May 09 20:25:38.962883 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 123/208] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:25:38 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:38.993391 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:38.994105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:39.001094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.001543 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.002315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.003128 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.129874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:39.130680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:39.137250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.137697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.138477 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.138909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.313053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:39.324791 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:39.326331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:39.327545 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0eda6498-7e3b-4082-9f8a-b92964b6ceab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1600 microversion: 2.20 time: 0.201508 May 09 20:25:39.328256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 124/209] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:25:39 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1600 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:25:39.348525 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a0091fd8-94ad-4c90-a952-83569ab6e0a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:39.350336 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a0091fd8-94ad-4c90-a952-83569ab6e0a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:39.357587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0091fd8-94ad-4c90-a952-83569ab6e0a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.358111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0091fd8-94ad-4c90-a952-83569ab6e0a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.358956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0091fd8-94ad-4c90-a952-83569ab6e0a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.359673 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0091fd8-94ad-4c90-a952-83569ab6e0a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.451096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a0091fd8-94ad-4c90-a952-83569ab6e0a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107458 May 09 20:25:39.451600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 125/210] 10.222.0.44 () {60 vars in 1315 bytes} [Mon May 9 20:25:39 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 20:25:39.527625 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:39.528628 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:39.538970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.539749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.540799 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.541453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.724323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:39.735309 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-29f9c574-5315-4cfb-b8ee-82eb20f718e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.743873 May 09 20:25:39.735844 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 86/211] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:38 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:39.950566 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:39.959665 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9e6f7397-2b9f-41c5-89ac-72083e2fe843 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1516 microversion: 2.1 time: 0.437193 May 09 20:25:39.960496 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 126/212] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:39 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1516 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:39.979007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:39.980074 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:39.988407 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.989159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:39.990070 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:39.990599 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:40.015939 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lazy-loading 'flavor' on Instance uuid 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:25:40.144700 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-25b23af9-73cd-4a66-aa62-a5a0b5bb2451 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6/action" status: 200 len: 32 microversion: 2.1 time: 0.170051 May 09 20:25:40.145593 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 87/213] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:25:39 2022] POST /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:25:40.154643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:40.155428 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:40.163807 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:40.164588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:40.165603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:40.166167 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:40.752156 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:40.761755 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4b7e9670-7791-4c21-ad1a-70602b02a6a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.610748 May 09 20:25:40.764324 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:40.765478 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:40.775157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 127/214] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:40 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:40.795084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:40.795859 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:40.797367 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:40.798194 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:41.348006 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:41.359274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c7a653c5-fbe5-4440-bb94-7011cd31c50c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.602771 May 09 20:25:41.364674 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-e91f1dc6-c019-4cfd-a846-4093d230a577 req-6cfd3d91-6fb3-4d3d-baac-46872690ad63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425e8732-2c2b-4c37-b2c3-e766712d293f", "tag": "9d1946fe-d370-43ff-a7d4-5a7d9c20d2be"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:41.378132 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 88/215] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:40 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:41.378247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-e91f1dc6-c019-4cfd-a846-4093d230a577 req-6cfd3d91-6fb3-4d3d-baac-46872690ad63 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:41.378247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-e91f1dc6-c019-4cfd-a846-4093d230a577 req-6cfd3d91-6fb3-4d3d-baac-46872690ad63 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:41.392781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-e91f1dc6-c019-4cfd-a846-4093d230a577 req-6cfd3d91-6fb3-4d3d-baac-46872690ad63 service nova] Creating event network-changed:9d1946fe-d370-43ff-a7d4-5a7d9c20d2be for instance 425e8732-2c2b-4c37-b2c3-e766712d293f on hv-cinder-83699 May 09 20:25:41.399130 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-e91f1dc6-c019-4cfd-a846-4093d230a577 req-6cfd3d91-6fb3-4d3d-baac-46872690ad63 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037785 May 09 20:25:41.403504 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 128/216] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:25:41.749481 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-7b7666c5-b585-43c2-a463-2f3b4a95abfd req-8c136668-3802-42f3-af4b-84f8c05de92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbed4907-edef-46b3-a625-306d3f840aae", "tag": "830153c9-f6de-4238-b8ca-24ec8e070f82"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:41.759104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-7b7666c5-b585-43c2-a463-2f3b4a95abfd req-8c136668-3802-42f3-af4b-84f8c05de92a service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:41.759914 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-7b7666c5-b585-43c2-a463-2f3b4a95abfd req-8c136668-3802-42f3-af4b-84f8c05de92a service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:41.784620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:41.785391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:41.797256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:41.797700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:41.799507 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-7b7666c5-b585-43c2-a463-2f3b4a95abfd req-8c136668-3802-42f3-af4b-84f8c05de92a service nova] Creating event network-changed:830153c9-f6de-4238-b8ca-24ec8e070f82 for instance fbed4907-edef-46b3-a625-306d3f840aae on hv-cinder-83699 May 09 20:25:41.800633 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:41.801063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:41.811626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-7b7666c5-b585-43c2-a463-2f3b4a95abfd req-8c136668-3802-42f3-af4b-84f8c05de92a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066734 May 09 20:25:41.813361 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 89/217] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:41.983749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:41.992943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7fb08260-2eeb-47bf-9446-35d67e86159e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.213244 May 09 20:25:41.993687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 129/218] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:41 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:25:42.387281 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:42.388076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:42.403389 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:42.404011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:42.404922 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:42.405496 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:42.633952 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:42.642042 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3a10a063-a442-404b-b065-9fb1f4233907 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1363 microversion: 2.1 time: 0.259876 May 09 20:25:42.642518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 90/219] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:42 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:43.012259 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:43.013636 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:43.020350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:43.021466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:43.022391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:43.023040 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:43.208738 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:43.216974 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f157e9f3-4cdc-4299-8c8d-7ed26fe3cbbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.210524 May 09 20:25:43.227447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 130/220] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:43 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:43.658545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:43.659165 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:43.669389 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:43.669896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:43.670641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:43.671077 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:44.234391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:44.235750 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:44.241839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:44.242488 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:44.243462 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:44.244079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:44.257694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:44.270390 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-35923056-1e39-41b8-8c52-1a1e14f67e55 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1548 microversion: 2.1 time: 0.615623 May 09 20:25:44.271779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 91/221] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:43 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1548 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:44.291985 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f46b29f1-ccb0-4a01-8fb2-3c1d042b8972 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:44.293011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f46b29f1-ccb0-4a01-8fb2-3c1d042b8972 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:44.302147 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f46b29f1-ccb0-4a01-8fb2-3c1d042b8972 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:44.302988 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f46b29f1-ccb0-4a01-8fb2-3c1d042b8972 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:44.304872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f46b29f1-ccb0-4a01-8fb2-3c1d042b8972 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:44.305337 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f46b29f1-ccb0-4a01-8fb2-3c1d042b8972 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:44.460111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:44.480470 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-303d3d2f-526b-404e-8270-3bc6bd1e63e3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.238495 May 09 20:25:44.482838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 131/222] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:44 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:44.507351 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f46b29f1-ccb0-4a01-8fb2-3c1d042b8972 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221547 May 09 20:25:44.508084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 92/223] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:25:44 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:25:45.500232 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:45.501908 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:45.507757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:45.508420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:45.509193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:45.509626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:45.660064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:45.670031 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ae829737-9596-4479-9941-e996b2208ee0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.175007 May 09 20:25:45.671032 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 132/224] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:45 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:45.865811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-dcf3cc41-9988-4a7f-abaa-2ca1a3df4bb8 req-40123ca0-b590-4bc8-a1e6-5cd4e06e95df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5859d0-753a-4eb6-9c16-6a21b2a0758b", "tag": "8757cf9e-6828-4f88-b34e-3338c7176b27"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:25:45.875510 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-dcf3cc41-9988-4a7f-abaa-2ca1a3df4bb8 req-40123ca0-b590-4bc8-a1e6-5cd4e06e95df service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:45.876028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-dcf3cc41-9988-4a7f-abaa-2ca1a3df4bb8 req-40123ca0-b590-4bc8-a1e6-5cd4e06e95df service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:45.888538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-dcf3cc41-9988-4a7f-abaa-2ca1a3df4bb8 req-40123ca0-b590-4bc8-a1e6-5cd4e06e95df service nova] Creating event network-changed:8757cf9e-6828-4f88-b34e-3338c7176b27 for instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b on hv-cinder-83699 May 09 20:25:45.898253 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-dcf3cc41-9988-4a7f-abaa-2ca1a3df4bb8 req-40123ca0-b590-4bc8-a1e6-5cd4e06e95df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036516 May 09 20:25:45.899071 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 93/225] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:25:46.688385 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:46.688999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:46.695100 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:46.695587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:46.696358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:46.696788 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:46.852867 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:46.861896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c1c4ce7b-7524-44d5-b674-6d5039c49ef3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.177819 May 09 20:25:46.862461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 133/226] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:46 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:47.885035 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:47.887562 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:47.897867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:47.898588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:47.899919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:47.900626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:48.050150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:48.057865 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9707abb6-141d-42a0-8dfc-aa30b1a7b908 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.180494 May 09 20:25:48.058546 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 94/227] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:47 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:49.074577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:49.075279 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:49.081309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:49.081752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:49.082512 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:49.082947 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:49.209138 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:49.217084 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4ec959bc-199f-4c79-9e30-fed1f6a70f96 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.146771 May 09 20:25:49.217649 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 134/228] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:49 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:50.234952 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:50.235602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:50.241839 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:50.242308 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:50.243081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:50.243533 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:50.436788 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:50.444296 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-48a1e3e8-0dcf-4182-a8ff-16bba1b7b8c4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.213752 May 09 20:25:50.445111 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 95/229] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:50 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:51.461013 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:51.461616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:51.467382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:51.467849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:51.468595 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:51.469019 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:51.601841 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:51.610532 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5fb4ae5e-9af4-431b-b445-0bb72189fc2e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.153251 May 09 20:25:51.611330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 135/230] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:51 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:52.628538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:52.629326 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:52.636181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:52.636895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:52.637731 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:52.638189 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:52.789103 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:52.796673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-02c86602-aa0b-40f1-8c09-515e7753880a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.171980 May 09 20:25:52.797229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 96/231] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:52 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:53.813986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:53.814590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:53.820982 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:53.821429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:53.822180 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:53.823270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:54.027282 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:54.039295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-eaa53a5b-0741-4791-a2e6-d114a93825a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.228998 May 09 20:25:54.042555 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 136/232] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:53 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:55.057528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:55.058357 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:55.064957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:55.065679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:55.066657 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:55.067313 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:55.225131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:55.232889 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-bc91cbb4-c058-422f-96e8-4563f084db87 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.179122 May 09 20:25:55.233854 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 97/233] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:55 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:56.251634 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:56.252381 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:56.259057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:56.259979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:56.264158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:56.264614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:56.511807 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:56.519828 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5050d0b0-075c-4d27-99fd-68236a762561 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.272948 May 09 20:25:56.520653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 137/234] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:56 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:57.162501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:57.163009 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:57.169871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:57.170656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:57.171593 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:57.172185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:57.199460 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:25:57.286100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-85774999-eb50-421a-9065-57b24b71c77b tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 204 len: 0 microversion: 2.1 time: 0.127002 May 09 20:25:57.286927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 98/235] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:25:57 2022] DELETE /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:25:57.295254 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:57.295909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:57.302129 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:57.302661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:57.303589 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:57.304162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:57.452951 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:57.460949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e8d4b517-50a3-4103-bb5e-55c92a8e623e tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1551 microversion: 2.1 time: 0.169606 May 09 20:25:57.461647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 138/236] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:57 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1551 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:57.538434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:57.539122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:57.546038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:57.546475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:57.547241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:57.547695 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:57.700455 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:57.709060 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f32a8e56-8c4d-48ea-ba76-f09c8aa3780c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.174029 May 09 20:25:57.709060 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 99/237] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:57 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:58.477578 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:58.478193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:58.484914 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:58.485387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:58.486217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:58.486675 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:58.627477 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:58.636116 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0b6727c1-2b98-4fa8-9744-a9cad6771cf8 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1551 microversion: 2.1 time: 0.162321 May 09 20:25:58.637004 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 139/238] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:58 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:58.726000 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:58.726602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:58.732994 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:58.733433 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:58.734178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:58.734603 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:58.863914 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:58.871723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5d593930-3cfe-41b3-beab-2ea9975670ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.149556 May 09 20:25:58.872278 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 100/239] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:58 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:59.653746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:59.654384 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:59.660939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:59.661382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:59.662188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:59.662618 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:59.829343 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:25:59.838510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6f75ec52-29a9-4344-95a7-86df5dbf5eab tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1551 microversion: 2.1 time: 0.189435 May 09 20:25:59.848921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 140/240] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:59 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:25:59.889741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:25:59.892161 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:25:59.906003 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:59.906462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:25:59.907304 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:25:59.908226 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:00.079866 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:00.087284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9796f2ac-344f-4b40-b7a5-37900c78dedb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.202385 May 09 20:26:00.091540 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 101/241] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:25:59 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:00.686993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-ff5c1d75-8fcb-4bf0-b39a-020a1a71e701 req-f7ecaf9b-8a29-43d5-8505-1a032dc0ea1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb02ec29-edbc-4126-beaf-29b18aa9557f", "name": "network-vif-deleted", "tag": "78543ee9-a62c-4f54-bf13-c8bbb28f3c08"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:26:00.695432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-ff5c1d75-8fcb-4bf0-b39a-020a1a71e701 req-f7ecaf9b-8a29-43d5-8505-1a032dc0ea1d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:00.695903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-ff5c1d75-8fcb-4bf0-b39a-020a1a71e701 req-f7ecaf9b-8a29-43d5-8505-1a032dc0ea1d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:00.708009 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-ff5c1d75-8fcb-4bf0-b39a-020a1a71e701 req-f7ecaf9b-8a29-43d5-8505-1a032dc0ea1d service nova] Creating event network-vif-deleted:78543ee9-a62c-4f54-bf13-c8bbb28f3c08 for instance bb02ec29-edbc-4126-beaf-29b18aa9557f on hv-cinder-83699 May 09 20:26:00.713556 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-ff5c1d75-8fcb-4bf0-b39a-020a1a71e701 req-f7ecaf9b-8a29-43d5-8505-1a032dc0ea1d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030337 May 09 20:26:00.714147 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 141/242] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:26:00.855739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:00.856370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:00.862500 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:00.863060 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:00.863978 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:00.864413 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:00.929419 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ed7ee782974e199e6202aca7b6e9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9825a892fe14e409eb97a504d3c8b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:00.938675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-35972563-bbd7-44a0-8a4a-cc4fe5fb760c tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 200 len: 1345 microversion: 2.1 time: 0.086854 May 09 20:26:00.939291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 102/243] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:00 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:01.104851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:01.105558 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:01.112448 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:01.113284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:01.113756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:01.114317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:01.285055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:01.294413 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-57bee852-167c-4a3a-b64c-e5f2fb78234f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.193631 May 09 20:26:01.296018 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 142/244] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:01 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:01.956156 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:01.956761 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:01.963174 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:01.963718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:01.964623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:01.965050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:01.978667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] HTTP exception thrown: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Request method failure captured: May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f HTTP/1.1 May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXh8PuiS-STSWkU2j5myr3EPbTWm7JbhIjHpwTYXZnC_goqbIYxE541N3nrYseWwQnrDYrfm2ghIcCIW95frSWkCVNF436m7RxH0CiqIWyhRerXG-0wARo70Fup2CEesnNLaX3VVqRVPaIn_hoWzRmLARR-1F8XlxYyUerqyiLTJX68 May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:26:01.983369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b9825a892fe14e409eb97a504d3c8b92"}]}] May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-DeleteServersTestJSON-588295943 May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: c6ed7ee782974e199e6202aca7b6e9e3 May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:01.984808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'bb02ec29-edbc-4126-beaf-29b18aa9557f'} May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:26:01.985568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:01.986726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:01.987896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Returning 404 to user: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:26:01.987896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a5a536d8-9ff4-463f-b388-7f82b744bb75 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 404 len: 111 microversion: 2.1 time: 0.032608 May 09 20:26:01.987896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 103/245] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:01 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:26:02.088951 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:02.089882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:02.095824 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:02.096271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:02.097036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:02.097469 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:02.110497 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] HTTP exception thrown: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Request method failure captured: May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f/os-volume_attachments HTTP/1.1 May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXh8PuiS-STSWkU2j5myr3EPbTWm7JbhIjHpwTYXZnC_goqbIYxE541N3nrYseWwQnrDYrfm2ghIcCIW95frSWkCVNF436m7RxH0CiqIWyhRerXG-0wARo70Fup2CEesnNLaX3VVqRVPaIn_hoWzRmLARR-1F8XlxYyUerqyiLTJX68 May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:26:02.114937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b9825a892fe14e409eb97a504d3c8b92"}]}] May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-DeleteServersTestJSON-588295943 May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: c6ed7ee782974e199e6202aca7b6e9e3 May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:02.116371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'server_id': 'bb02ec29-edbc-4126-beaf-29b18aa9557f'} May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:26:02.117153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:02.118387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:02.120257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Returning 404 to user: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:26:02.120257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-17a87bf1-1cf4-4b06-bbcc-3775153cc2af tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031287 May 09 20:26:02.120257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 143/246] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:26:02 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:26:02.312796 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:02.313522 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:02.319246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:02.319722 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:02.320476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:02.320901 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:02.457378 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:02.465917 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-354c35ff-c0e2-4eb0-b63f-e779cb94f0bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.156922 May 09 20:26:02.467436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 104/247] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:02 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:03.304477 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:03.304983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:03.311863 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:03.312368 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:03.313142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:03.313600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:03.327918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] HTTP exception thrown: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Request method failure captured: May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f HTTP/1.1 May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXh8PuiS-STSWkU2j5myr3EPbTWm7JbhIjHpwTYXZnC_goqbIYxE541N3nrYseWwQnrDYrfm2ghIcCIW95frSWkCVNF436m7RxH0CiqIWyhRerXG-0wARo70Fup2CEesnNLaX3VVqRVPaIn_hoWzRmLARR-1F8XlxYyUerqyiLTJX68 May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:26:03.329961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b9825a892fe14e409eb97a504d3c8b92"}]}] May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-DeleteServersTestJSON-588295943 May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: c6ed7ee782974e199e6202aca7b6e9e3 May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.331265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': 'bb02ec29-edbc-4126-beaf-29b18aa9557f'} May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:26:03.331948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.333353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:26:03.334383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Returning 404 to user: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:26:03.334383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-adcb2e3f-5de6-4932-bd3b-80f5d62e407d tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 404 len: 111 microversion: 2.1 time: 0.030833 May 09 20:26:03.334383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 144/248] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:26:03 2022] DELETE /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:26:03.341440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:03.342053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] [instance: bb02ec29-edbc-4126-beaf-29b18aa9557f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:03.349955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:03.350394 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:03.351157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:03.351615 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:03.365413 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] HTTP exception thrown: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Request method failure captured: May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f HTTP/1.1 May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXh8PuiS-STSWkU2j5myr3EPbTWm7JbhIjHpwTYXZnC_goqbIYxE541N3nrYseWwQnrDYrfm2ghIcCIW95frSWkCVNF436m7RxH0CiqIWyhRerXG-0wARo70Fup2CEesnNLaX3VVqRVPaIn_hoWzRmLARR-1F8XlxYyUerqyiLTJX68 May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:26:03.367034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b9825a892fe14e409eb97a504d3c8b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b9825a892fe14e409eb97a504d3c8b92"}]}] May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-DeleteServersTestJSON-588295943 May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: b9825a892fe14e409eb97a504d3c8b92 May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-DeleteServersTestJSON-588295943 May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: c6ed7ee782974e199e6202aca7b6e9e3 May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-DeleteServersTestJSON-588295943-project May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.368336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'bb02ec29-edbc-4126-beaf-29b18aa9557f'} May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:26:03.369545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. May 09 20:26:03.370941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:03.373023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] Returning 404 to user: Instance bb02ec29-edbc-4126-beaf-29b18aa9557f could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:26:03.373023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c17efa6f-4f66-47ca-9e82-9be66e3ff1b9 tempest-DeleteServersTestJSON-588295943 tempest-DeleteServersTestJSON-588295943-project] 10.222.0.44 "GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f" status: 404 len: 111 microversion: 2.1 time: 0.032154 May 09 20:26:03.373023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 105/249] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:03 2022] GET /compute/v2.1/servers/bb02ec29-edbc-4126-beaf-29b18aa9557f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:26:03.484420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:03.485437 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:03.492820 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:03.493387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:03.494973 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:03.494973 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:03.701424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:03.708736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7355db69-09a3-4dd0-933a-e748760ac44e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.229197 May 09 20:26:03.709295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 145/250] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:03 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:04.727074 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:04.727750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:04.737065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:04.737749 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:04.738888 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:04.739623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:04.908718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:04.916653 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0b806c5e-d09c-4162-8a55-e865e20cb911 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.194358 May 09 20:26:04.917325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 106/251] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:04 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:05.934424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:05.935215 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:05.943629 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:05.944385 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:05.945374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:05.946143 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:06.115452 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:06.125778 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-df5ee260-b5dc-4f16-bde9-9ed029c09183 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.195729 May 09 20:26:06.128415 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 146/252] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:05 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:07.146051 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:07.146664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:07.153283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:07.153809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:07.154631 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:07.155120 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:07.286694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:07.294766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9ad5287d-6d44-41c8-b442-e2acc469bc42 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.152648 May 09 20:26:07.295330 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 107/253] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:07 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:08.311750 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:08.312291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:08.318173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:08.318622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:08.319377 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:08.319907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:08.423550 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-01816b3f-e700-4161-96b8-861bdace2242 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62be06c430>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:08.448953 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:08.456316 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-28d689a8-b06b-49b5-8bda-03e26d9c196b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.148545 May 09 20:26:08.456895 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 147/254] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:08 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:08.471618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-01816b3f-e700-4161-96b8-861bdace2242 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f35f6629-e1d1-450a-ba9e-b09d94b82ffc" status: 200 len: 351 microversion: 2.1 time: 0.051955 May 09 20:26:08.472187 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 108/255] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:26:08 2022] GET /compute/v2.1/os-volumes/f35f6629-e1d1-450a-ba9e-b09d94b82ffc => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:26:09.474127 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:09.474819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:09.481332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:09.481810 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:09.482587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:09.483043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:09.628038 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:09.635938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3215ae90-80f7-44ea-9e12-0ce08bed3001 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.165701 May 09 20:26:09.636738 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 148/256] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:09 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:09.820393 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-afd7ce00-4bff-49ab-b7bc-cd0204c23955 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bcf1c4c0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:09.872184 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-afd7ce00-4bff-49ab-b7bc-cd0204c23955 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/05ef8b75-fd5a-484a-be42-e1ec8d8fb2db" status: 200 len: 351 microversion: 2.1 time: 0.056003 May 09 20:26:09.872754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 109/257] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:26:09 2022] GET /compute/v2.1/os-volumes/05ef8b75-fd5a-484a-be42-e1ec8d8fb2db => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:26:10.653723 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:10.654338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:10.660275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:10.660723 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:10.661484 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:10.661911 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:10.805705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:10.813142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4132912d-f781-42c8-9fe2-6ce8b87ec61f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.163768 May 09 20:26:10.813689 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 149/258] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:10 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:11.195858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cda03fb2-a4d4-4b27-98d8-fc57f4bff4b1 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bcf001f0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.241493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cda03fb2-a4d4-4b27-98d8-fc57f4bff4b1 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6f2093d6-2399-48f1-aa8d-e7b2da3e3058" status: 200 len: 351 microversion: 2.1 time: 0.050307 May 09 20:26:11.242053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 110/259] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes/6f2093d6-2399-48f1-aa8d-e7b2da3e3058 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:26:11.252888 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1a7f1c2c-58e8-438d-a003-1426812677f5 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bd723040>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.353451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1a7f1c2c-58e8-438d-a003-1426812677f5 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.104216 May 09 20:26:11.355302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 150/260] 10.222.0.44 () {58 vars in 1133 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:11.365938 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-adf10bb2-9aac-403a-8082-6d783c99f4c7 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bcf1cee0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.444810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-adf10bb2-9aac-403a-8082-6d783c99f4c7 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082585 May 09 20:26:11.445379 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 111/261] 10.222.0.44 () {58 vars in 1148 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:26:11.457675 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0dbd93cb-db43-460f-a021-1e188e833973 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bd728af0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.536543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0dbd93cb-db43-460f-a021-1e188e833973 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082541 May 09 20:26:11.537121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 151/262] 10.222.0.44 () {58 vars in 1133 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:11.548016 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3b71f097-ec17-4c29-9772-f8fde9c22e23 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bcf519d0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.629977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3b71f097-ec17-4c29-9772-f8fde9c22e23 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085536 May 09 20:26:11.630615 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 112/263] 10.222.0.44 () {58 vars in 1166 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:26:11.643008 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-73555307-6277-4b30-8dd4-4efe89cd7fe7 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bd7283a0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.720919 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-73555307-6277-4b30-8dd4-4efe89cd7fe7 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081545 May 09 20:26:11.721468 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 152/264] 10.222.0.44 () {58 vars in 1169 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:26:11.733104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-371aabc4-89ef-48dd-9038-963d08836989 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bce03dc0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.813840 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-371aabc4-89ef-48dd-9038-963d08836989 tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084336 May 09 20:26:11.814413 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 113/265] 10.222.0.44 () {58 vars in 1154 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:11.825887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e36c137c-76cf-44fd-8b39-18017c37fcec tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bd69da60>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.829545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.830147 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:11.836342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:11.836972 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:11.838086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:11.838526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:11.921433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e36c137c-76cf-44fd-8b39-18017c37fcec tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099675 May 09 20:26:11.927648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 153/266] 10.222.0.44 () {58 vars in 1187 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:26:11.936230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0bc09f46-7a08-41d9-b418-21a69ba1b1fc tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] Calling method '.version_select at 0x7f62bd6ac700>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:11.985176 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:11.992438 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fa41ffb4-38a5-4115-8f23-af3e879e88b4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.166538 May 09 20:26:11.992996 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 114/267] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:26:12.023532 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0bc09f46-7a08-41d9-b418-21a69ba1b1fc tempest-VolumesTestJSON-1070637057 tempest-VolumesTestJSON-1070637057-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.091955 May 09 20:26:12.024135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 154/268] 10.222.0.44 () {58 vars in 1154 bytes} [Mon May 9 20:26:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:26:13.010524 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:13.011083 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:13.018269 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:13.019023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:13.019809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:13.020235 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:13.153393 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:13.160907 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-518d30be-51d3-4bc2-a638-0c5ae38d8d59 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.155154 May 09 20:26:13.161445 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 115/269] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:13 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:14.177870 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:14.178385 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:14.185121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:14.185567 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:14.186328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:14.186763 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:14.320815 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:14.328744 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f2e9dfd1-9881-41b1-b7b9-99dd2b7d535d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.154781 May 09 20:26:14.329447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 155/270] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:14 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:15.346457 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:15.347063 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:15.354488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:15.354936 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:15.355742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:15.356182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:15.493187 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:15.500902 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d7de8d57-b281-4626-8152-7f6394c541a9 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.158452 May 09 20:26:15.501478 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 116/271] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:15 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:26:16.518333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:16.519011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:16.524977 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:16.525421 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:16.526184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:16.526803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:16.679293 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:16.687436 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6812d942-53b6-492f-ae6d-e8f9805c5d9b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.172952 May 09 20:26:16.688026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 156/272] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:16 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:17.706477 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:17.707265 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:17.713323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:17.713774 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:17.714547 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:17.715008 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:17.853617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:17.861718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7668b72a-e3ca-46b1-937f-01aaa7ea2ac7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.159387 May 09 20:26:17.862282 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 117/273] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:17 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:18.882251 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:18.882251 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:18.892082 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:18.892796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:18.894279 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:18.894468 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:19.044445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:19.052273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fdc6e60d-6893-4ca0-ba5b-a6f9a8fa6c44 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.175393 May 09 20:26:19.052834 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 157/274] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:18 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:20.079050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:20.079970 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:20.086297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:20.086950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:20.088176 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:20.088778 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:20.233994 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:20.241317 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-444ea24b-fbf8-4f18-a514-4c3fc28ef2b1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1522 microversion: 2.1 time: 0.175267 May 09 20:26:20.242053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 118/275] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:20 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:21.259001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:21.259684 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:21.265855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:21.266303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:21.267075 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:21.267514 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:21.403779 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:21.410934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-17f26d8a-b4ad-4300-861f-86edb5734379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1502 microversion: 2.1 time: 0.155720 May 09 20:26:21.411514 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 158/276] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:21 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:21.426979 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:21.427700 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:21.434598 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:21.435034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:21.435812 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:21.436242 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:21.568407 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:21.578258 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-bc688867-dcb7-4709-96c6-3f499207a4c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1517 microversion: 2.1 time: 0.154864 May 09 20:26:21.578944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 119/277] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:21 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:24.029266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:26:24.036482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:24.046945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:24.047500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:24.052879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:24.053548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:24.082510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lazy-loading 'flavor' on Instance uuid a55e260a-09eb-4d67-9271-5fe7c21cab71 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:26:24.372814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0655d7ae-8933-4e37-ba33-d08e31b20b83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71/action" status: 200 len: 32 microversion: 2.1 time: 0.357841 May 09 20:26:24.373407 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 159/278] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:26:24 2022] POST /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71/action => generated 32 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:26:24.384474 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:24.385641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:24.393019 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:24.393742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:24.394679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:24.395084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:24.609088 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:24.616756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6befec09-9dc6-4f51-856b-70420cc0f602 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.236230 May 09 20:26:24.617515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 120/279] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:24 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:26:25.634916 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:25.635711 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:25.641907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:25.642443 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:25.643280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:25.643893 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:25.775876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:25.783124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1af5bc29-ac00-4779-94a1-a2582518bc02 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.153019 May 09 20:26:25.783987 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 160/280] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:25 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:26.800219 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:26.800782 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:26.807482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:26.807932 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:26.808696 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:26.809133 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:26.939062 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:26.946909 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b446a6e6-01ae-4a27-b38b-d7734c9096c8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.150100 May 09 20:26:26.947651 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 121/281] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:26 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:27.963781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:27.964391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:27.970256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:27.970691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:27.971462 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:27.971892 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:28.107479 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:28.116431 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1172624a-b34e-4fd3-a353-ee08a9abd012 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.157229 May 09 20:26:28.119106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 161/282] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:27 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:29.135448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:29.136089 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:29.142602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:29.143039 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:29.143817 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:29.144245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:29.271295 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:29.283185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-63791fbd-c618-468d-8a40-52f03b8bfe37 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.152243 May 09 20:26:29.283790 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 122/283] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:29 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:30.299972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:30.300582 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:30.306389 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:30.306828 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:30.307622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:30.308047 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:30.437468 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:30.444709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0e004fcd-d94f-400a-9a42-1b1baa8f6973 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.148429 May 09 20:26:30.445257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 162/284] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:30 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:31.462700 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:31.463317 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:31.470069 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:31.470515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:31.471274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:31.471746 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:31.598100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:31.605940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-626628fb-17b1-463b-89e0-aae8ec020115 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.147588 May 09 20:26:31.606494 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 123/285] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:31 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:32.622817 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:32.623456 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:32.629290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:32.629737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:32.630482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:32.630910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:32.755197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:32.763518 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-42ad8a68-a413-4b22-9ac5-adf819af9487 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.145386 May 09 20:26:32.764073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 163/286] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:32 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:33.781090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:33.781698 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:33.787990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:33.788429 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:33.789181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:33.789606 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:33.923590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:33.931860 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-11f2138d-7cdc-4541-8193-f38a87df0532 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.153517 May 09 20:26:33.932555 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 124/287] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:33 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:34.949097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:34.949716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:34.955693 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:34.956137 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:34.956932 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:34.957362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:35.094411 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:35.102066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-07ec4f47-12b9-4eb0-b53d-1ef96b892047 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.156986 May 09 20:26:35.103327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 164/288] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:34 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:36.120059 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:36.120671 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:36.127039 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:36.127511 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:36.128546 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:36.128976 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:36.255867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:36.263993 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-efee0c72-d943-4efa-8cff-26f70888e34b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.148210 May 09 20:26:36.264552 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 125/289] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:36 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:37.281485 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:37.282080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:37.287982 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:37.288429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:37.289192 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:37.289628 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:37.443561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:37.451424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-84d4f737-03d8-4d93-82dc-c15c2972a103 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.173876 May 09 20:26:37.452432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 165/290] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:37 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:38.469314 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:38.470573 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:38.476997 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:38.478108 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:38.478849 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:38.479278 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:38.615313 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:38.624493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b34f988e-b392-46f3-afb1-6533bfa960e8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.159050 May 09 20:26:38.625130 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 126/291] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:38 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:39.641813 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:39.642457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:39.648404 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:39.648928 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:39.650320 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:39.650754 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:39.775216 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:39.782404 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-651b8e98-678a-47e4-a51e-e2092fa151f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.144410 May 09 20:26:39.783064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 166/292] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:39 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:40.798847 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:40.799371 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:40.805784 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:40.806277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:40.807040 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:40.807488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:40.939828 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:40.947955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-da4dbcca-21e4-437d-81d5-6f7104823c16 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.153287 May 09 20:26:40.948536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 127/293] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:40 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:41.965273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:41.965882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:41.972007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:41.972453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:41.973225 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:41.973664 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:42.100842 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:42.108667 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b8a404fb-0019-47cd-9855-150866ca3503 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.147662 May 09 20:26:42.109228 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 167/294] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:41 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:43.127923 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:43.128528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:43.135484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:43.135921 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:43.136922 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:43.137344 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:43.269382 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:43.276539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d10958d0-f413-4b4f-bf6d-6575c1c25fc1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.152477 May 09 20:26:43.277096 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 128/295] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:43 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:44.293861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:44.294464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:44.300515 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:44.300956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:44.301705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:44.302132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:44.428341 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:44.436346 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9eddb352-c651-4379-b03e-0c837d7d489d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.146878 May 09 20:26:44.436994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 168/296] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:44 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:45.453681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:45.454323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:45.461191 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:45.462220 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:45.463001 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:45.463454 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:45.595518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:45.603377 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8e294511-9a15-4adc-8ff6-2c619d2493d4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.153722 May 09 20:26:45.603955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 129/297] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:45 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:46.620132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:46.620745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:46.627271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:46.628165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:46.629005 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:46.629599 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:46.768893 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:46.776181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2e194417-d47e-4dd1-8ca3-782ec7b14021 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.159877 May 09 20:26:46.776737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 169/298] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:46 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:47.792676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:47.793279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:47.799495 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:47.799936 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:47.800686 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:47.801110 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:47.925879 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:47.933635 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-33ce07cd-7335-4120-9f6a-bbc67aa71456 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.144715 May 09 20:26:47.934196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 130/299] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:47 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:48.951891 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:48.952510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:48.958680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:48.959132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:48.959979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:48.960411 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:49.086827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:49.094090 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-15bc19c3-3bd7-4a77-a306-15f6d375aad7 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.146091 May 09 20:26:49.094651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 170/300] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:48 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:50.111675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:50.112046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:50.118274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:50.118719 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:50.119513 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:50.119942 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:50.252196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:50.260318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-308da128-252a-4368-af39-d6e7a51c17a3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.152757 May 09 20:26:50.260893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 131/301] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:50 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:51.277877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:51.278484 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:51.284354 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:51.284794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:51.285555 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:51.285981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:51.409858 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:51.417737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ae78c7c9-0669-4304-8fc1-ccc968ed56f8 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.144197 May 09 20:26:51.418289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 171/302] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:51 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:52.436273 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:52.436811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:52.443052 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:52.443527 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:52.444289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:52.444723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:52.571922 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:52.579244 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8157105f-dee1-416e-b4d1-3b3c6e4e3e83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.146901 May 09 20:26:52.579833 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 132/303] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:52 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:53.596290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:53.596844 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:53.603544 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:53.603992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:53.604780 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:53.605212 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:53.731575 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:53.738728 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8901febb-999b-4db9-a1ca-2e88974cad3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.146472 May 09 20:26:53.739287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 172/304] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:53 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:54.756068 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:54.756678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:54.763264 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:54.763732 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:54.764483 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:54.764910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:54.890325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:54.897664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1bd9efb7-5b27-4345-877e-8152eb7e5e07 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.145478 May 09 20:26:54.898434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 133/305] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:54 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:55.916483 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:55.917094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:55.922960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:55.923426 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:55.924199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:55.924628 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:56.050776 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:56.058539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a42aad11-0c2e-442f-bd34-d3f055d4a679 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.145916 May 09 20:26:56.059093 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 173/306] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:55 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:57.076852 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:57.077462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:57.083872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:57.084324 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:57.085094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:57.085534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:57.212544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:57.219808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8e0a2959-f412-481f-bee2-be3a884e16e0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.146864 May 09 20:26:57.220374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 134/307] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:57 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:58.236744 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:58.237351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:58.244890 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.245382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.246136 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.246564 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.375736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:58.382833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-00afbf19-2530-4be6-ac5a-ca8b7e5b70e5 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1503 microversion: 2.1 time: 0.149952 May 09 20:26:58.383952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 174/308] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:58 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:58.400802 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbf84d0a-92d5-42df-92ee-e95dc4f4892b"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:26:58.401895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:58.408142 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.408590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.409347 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.409780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.431622 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] HTTP exception thrown: Cannot 'attach_volume' instance a55e260a-09eb-4d67-9271-5fe7c21cab71 while it is in vm_state rescued May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Request method failure captured: May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: POST /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71/os-volume_attachments HTTP/1.1 May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 74 May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiFsWQLIuO_MFnR6wXlqONSU-j1NHvohap0NnRPLJqroveZcYxwK4WYSQQ0nEZPDNIIOOvTvyXTOfii11W38YqbShW2XvMbKpI_IXPpfVP3e1dODEezPuqZyfDVKRs5HqTmMvCkOl-kqpmTiORx0H76ve0b1M7AbcA-BXbp9FC3xMY May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:26:58.433152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96a116cd334648f185dbf35bfa3ade00"}]}] May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 797d7c0dfda747549456236e9e639466 May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {"volumeAttachment": {"volumeId": "cbf84d0a-92d5-42df-92ee-e95dc4f4892b"}} May 09 20:26:58.434673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Cannot 'attach_volume' instance a55e260a-09eb-4d67-9271-5fe7c21cab71 while it is in vm_state rescued May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'server_id': 'a55e260a-09eb-4d67-9271-5fe7c21cab71', 'body': {'volumeAttachment': {'volumeId': 'cbf84d0a-92d5-42df-92ee-e95dc4f4892b'}}} May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a55e260a-09eb-4d67-9271-5fe7c21cab71 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:26:58.435630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a55e260a-09eb-4d67-9271-5fe7c21cab71 while it is in vm_state rescued May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:26:58.437015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:26:58.438356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:26:58.438356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:26:58.438356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a55e260a-09eb-4d67-9271-5fe7c21cab71 while it is in vm_state rescued May 09 20:26:58.438356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:26:58.438356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Returning 409 to user: Cannot 'attach_volume' instance a55e260a-09eb-4d67-9271-5fe7c21cab71 while it is in vm_state rescued {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:26:58.438356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-58b92d28-b962-4eb6-978d-ed1351acfdbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038413 May 09 20:26:58.438356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 135/309] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:26:58 2022] POST /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 20:26:58.443508 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e4e10446-8dc1-4318-a0ca-72d4e9df01bb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:26:58.444058 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e4e10446-8dc1-4318-a0ca-72d4e9df01bb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:58.450371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4e10446-8dc1-4318-a0ca-72d4e9df01bb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.450815 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4e10446-8dc1-4318-a0ca-72d4e9df01bb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.451729 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4e10446-8dc1-4318-a0ca-72d4e9df01bb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.452369 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4e10446-8dc1-4318-a0ca-72d4e9df01bb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.515981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e4e10446-8dc1-4318-a0ca-72d4e9df01bb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71/action" status: 202 len: 0 microversion: 2.1 time: 0.076159 May 09 20:26:58.516595 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 175/310] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:26:58 2022] POST /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:26:58.525335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:58.525943 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:58.531910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.532356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.533123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:58.533614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:58.748797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:58.756124 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5fd354b3-0a68-4b0e-ad7f-10c2e39f269d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1511 microversion: 2.1 time: 0.235187 May 09 20:26:58.756882 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 136/311] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:58 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:26:59.775526 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:26:59.776230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:26:59.782289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:59.782739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:59.783528 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:26:59.783975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:26:59.917060 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:26:59.924429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-cb633013-d3a4-4710-b5e4-978025a78364 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1511 microversion: 2.1 time: 0.154037 May 09 20:26:59.925017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 176/312] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:26:59 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:00.941816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:00.942442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:00.948763 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:00.949208 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:00.949987 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:00.950413 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:01.074252 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:01.081404 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1b32f768-ead3-49be-bc66-39b8c1dc2aec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1511 microversion: 2.1 time: 0.143487 May 09 20:27:01.081960 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 137/313] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:00 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1511 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:02.098520 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:02.099032 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:02.105511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:02.105953 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:02.106708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:02.107135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:02.231414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:02.239018 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e0b58992-b83c-432e-af0c-9ad752a5eefb tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1511 microversion: 2.1 time: 0.144395 May 09 20:27:02.239601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 177/314] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:02 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:03.257396 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:03.258651 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:03.265191 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:03.265637 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:03.266395 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:03.266843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:03.393771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:03.401012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c323b3be-b039-4de4-b867-28bce4eb38aa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1511 microversion: 2.1 time: 0.147392 May 09 20:27:03.401572 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 138/315] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:03 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:04.418173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:04.418818 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:04.424892 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:04.425341 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:04.426107 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:04.426544 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:04.554131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:04.561579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-df94a513-b9e3-4835-9065-d2f7dbe2c379 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1511 microversion: 2.1 time: 0.147367 May 09 20:27:04.562155 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 178/316] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:04 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:05.579073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:05.579948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:05.586973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:05.587539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:05.588469 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:05.588964 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:05.721898 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:05.730460 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d51241af-7c0c-432f-a186-afdb411b1544 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1511 microversion: 2.1 time: 0.155834 May 09 20:27:05.731811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 139/317] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:05 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:06.749292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:06.749927 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:06.755714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:06.756159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:06.756919 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:06.757346 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:06.883026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:06.890836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-29438a42-c66d-48b5-8f6b-290f10c700d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1517 microversion: 2.1 time: 0.145514 May 09 20:27:06.891418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 179/318] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:06 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1517 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:08.225761 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a8460144-c75f-4b54-b63a-62c340214e99 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'create', calling method: .version_select at 0x7f62bcda2ee0>, body: {"keypair": {"name": "tempest-keypair-1669099638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXZ7XBc5eXprGhCw2DEfrAAzAMT1zXdHrWwXPxvX8rWZ+MDCLWZZBA5Bi3XXFZc/OUF9FLATUwtKR/R3PKdWyqimr17rVCSh0yvYDn3K5faRvhBMTl/wyA5wVmms7oMgg=="}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:08.240768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-a8460144-c75f-4b54-b63a-62c340214e99 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for project 96a116cd334648f185dbf35bfa3ade00. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:27:08.245176 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-a8460144-c75f-4b54-b63a-62c340214e99 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for user 797d7c0dfda747549456236e9e639466 and project 96a116cd334648f185dbf35bfa3ade00. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:27:08.265568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a8460144-c75f-4b54-b63a-62c340214e99 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043547 May 09 20:27:08.266145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 140/319] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:27:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:27:09.550087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-378263126", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5211c87-473c-4568-883c-02b482c6282d"}], "security_groups": [{"name": "tempest-securitygroup--1685905897"}], "key_name": "tempest-keypair-1669099638", "user_data": "}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:09.657643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] validate_networks() for [('b5211c87-473c-4568-883c-02b482c6282d', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:27:10.037385 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:27:10.037799 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:27:10.038266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:27:10.038670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:27:10.039408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:27:10.047986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:10.048526 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:10.049253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:10.049686 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:10.066983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for project 96a116cd334648f185dbf35bfa3ade00. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:27:10.072023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Getting quotas for user 797d7c0dfda747549456236e9e639466 and project 96a116cd334648f185dbf35bfa3ade00. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:27:10.082909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:27:10.085216 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:27:10.133377 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-eb977e88-8cad-44a5-b56f-240d01ff3c19 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.587368 May 09 20:27:10.134352 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 180/320] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:27:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:27:10.144837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-734c3b71-479e-40ec-80a5-67e0f9d6457e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:10.145579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-734c3b71-479e-40ec-80a5-67e0f9d6457e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:10.205422 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-734c3b71-479e-40ec-80a5-67e0f9d6457e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:10.215337 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-734c3b71-479e-40ec-80a5-67e0f9d6457e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1245 microversion: 2.1 time: 0.074708 May 09 20:27:10.216986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 141/321] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:10 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:27:11.235053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:11.237075 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:11.248055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:11.255302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:11.258668 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:11.259527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:11.357783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:11.365922 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a045ac74-1d15-4ace-ab4b-b62338575831 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1303 microversion: 2.1 time: 0.135807 May 09 20:27:11.367831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 181/322] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:11 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:12.385101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:12.385661 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:12.392226 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:12.392665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:12.393450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:12.393886 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:12.598198 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:12.607188 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b5dd713d-2da5-491e-9227-ec8be3620502 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.226749 May 09 20:27:12.608093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 142/323] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:12 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:12.840003 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-81b413d7-09a7-498a-927a-9dd4cb9c8bc8 req-f9c2ce57-a562-4c7b-a30c-1ee4643c18eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51484383-fe65-4cb3-9ed3-d42efa4bc5f9", "tag": "e33030b9-6c9e-4361-9911-d23fdfcce223"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:12.851867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1804228432", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "networks": [{"uuid": "f317edff-310d-49be-af90-086d8a71b534"}]}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:12.855226 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-81b413d7-09a7-498a-927a-9dd4cb9c8bc8 req-f9c2ce57-a562-4c7b-a30c-1ee4643c18eb service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:12.855711 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-81b413d7-09a7-498a-927a-9dd4cb9c8bc8 req-f9c2ce57-a562-4c7b-a30c-1ee4643c18eb service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:12.868502 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-81b413d7-09a7-498a-927a-9dd4cb9c8bc8 req-f9c2ce57-a562-4c7b-a30c-1ee4643c18eb service nova] Creating event network-changed:e33030b9-6c9e-4361-9911-d23fdfcce223 for instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 on hv-cinder-83699 May 09 20:27:12.873588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-81b413d7-09a7-498a-927a-9dd4cb9c8bc8 req-f9c2ce57-a562-4c7b-a30c-1ee4643c18eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038529 May 09 20:27:12.874654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 182/324] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:27:12.916014 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] validate_networks() for [('f317edff-310d-49be-af90-086d8a71b534', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:27:13.489127 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:27:13.489754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:27:13.490076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:27:13.490472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:27:13.490871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:27:13.502479 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:13.502951 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:13.503757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:13.504184 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:13.520866 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Getting quotas for project 970fffc753884be893292412dc3a6f69. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:27:13.525448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Getting quotas for user 3e50a700ac8f4e708b23e35ffa57e4cf and project 970fffc753884be893292412dc3a6f69. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:27:13.536497 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:27:13.538746 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:27:13.583520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a84f5082-20f7-4b71-94e2-b6fcc37fc710 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740251 May 09 20:27:13.584243 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 143/325] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:27:13.595387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-002a12ca-bd66-49cc-ad1d-2d6a2618f578 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:13.596229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-002a12ca-bd66-49cc-ad1d-2d6a2618f578 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:13.624425 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:13.625385 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:13.634256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:13.634949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:13.635756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:13.636188 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:13.652007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-002a12ca-bd66-49cc-ad1d-2d6a2618f578 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:13.659309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-002a12ca-bd66-49cc-ad1d-2d6a2618f578 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1219 microversion: 2.1 time: 0.068127 May 09 20:27:13.660111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 183/326] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:13 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:13.780693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:13.788162 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-af34b9c6-9886-41f2-9105-c723f8803b9d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.167607 May 09 20:27:13.788721 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 144/327] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:13 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:14.676536 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:14.677145 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:14.683928 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:14.684373 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:14.685126 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:14.685556 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:14.747298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:14.754507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9b467c35-95d1-45c4-8fe1-66911627fce3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1223 microversion: 2.1 time: 0.081897 May 09 20:27:14.755067 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 184/328] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:14 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:14.806114 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:14.806759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:14.813073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:14.813520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:14.814285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:14.814722 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:14.944218 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:14.951383 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d1017fbe-2d85-46bc-a81a-dc42623d5e8b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.149829 May 09 20:27:14.951959 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 145/329] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:14 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:15.771724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:15.772329 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:15.778783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:15.779220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:15.780001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:15.780430 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:15.838142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:15.845150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a75a732e-8b80-485a-b44d-ff47b7eccc57 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1223 microversion: 2.1 time: 0.077260 May 09 20:27:15.845700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 185/330] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:15 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1223 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:27:15.967512 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:15.968185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:15.974397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:15.974851 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:15.975645 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:15.976081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:16.099992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:16.107601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-038450f5-4528-4676-9a36-dd392f9f56ff tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.144131 May 09 20:27:16.108168 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 146/331] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:15 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:16.861819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:16.862650 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:16.869873 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:16.870399 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:16.871257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:16.871781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:16.940965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:16.949568 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9b00e485-ca90-478d-a2b0-fccce45070a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1277 microversion: 2.1 time: 0.091585 May 09 20:27:16.950192 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 186/332] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:16 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:17.125028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:17.125648 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:17.132342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:17.132871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:17.133656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:17.134088 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:17.308035 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:17.316548 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3537614d-e9a8-4ea3-9384-acecca5f3873 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.195380 May 09 20:27:17.317394 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 147/333] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:17 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:17.966131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:17.966755 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:17.972878 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:17.973329 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:17.974096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:17.974533 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:18.102260 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:18.110182 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-25653ec5-a46d-4bae-93fd-1c042031cd79 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1319 microversion: 2.1 time: 0.147919 May 09 20:27:18.110784 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 187/334] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:17 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:18.159529 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-1149103e-d44a-41dc-8f8b-56af8fdbb445 req-f759f39c-1fb9-48e6-95fe-27c1cdbdec64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf", "tag": "474292af-32d0-4620-aeed-ccf48a0c7f15"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:18.168938 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-1149103e-d44a-41dc-8f8b-56af8fdbb445 req-f759f39c-1fb9-48e6-95fe-27c1cdbdec64 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:18.169687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-1149103e-d44a-41dc-8f8b-56af8fdbb445 req-f759f39c-1fb9-48e6-95fe-27c1cdbdec64 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:18.181462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-1149103e-d44a-41dc-8f8b-56af8fdbb445 req-f759f39c-1fb9-48e6-95fe-27c1cdbdec64 service nova] Creating event network-changed:474292af-32d0-4620-aeed-ccf48a0c7f15 for instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf on hv-cinder-83699 May 09 20:27:18.186237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-1149103e-d44a-41dc-8f8b-56af8fdbb445 req-f759f39c-1fb9-48e6-95fe-27c1cdbdec64 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030516 May 09 20:27:18.186842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 148/335] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:27:18.333969 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:18.334574 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:18.341538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:18.341991 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:18.342766 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:18.343202 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:18.475831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:18.483872 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3d68a97c-4268-4ff1-83e1-318499885132 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.153636 May 09 20:27:18.484443 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 188/336] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:18 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:18.720038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-85141d75-fc75-438e-a9d1-592f8d15bbb4 req-c079953e-2889-4da4-b521-adf1cd2f8361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51484383-fe65-4cb3-9ed3-d42efa4bc5f9", "name": "network-vif-plugged", "status": "completed", "tag": "e33030b9-6c9e-4361-9911-d23fdfcce223"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:18.728705 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-85141d75-fc75-438e-a9d1-592f8d15bbb4 req-c079953e-2889-4da4-b521-adf1cd2f8361 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:18.729237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-85141d75-fc75-438e-a9d1-592f8d15bbb4 req-c079953e-2889-4da4-b521-adf1cd2f8361 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:18.739881 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-85141d75-fc75-438e-a9d1-592f8d15bbb4 req-c079953e-2889-4da4-b521-adf1cd2f8361 service nova] Creating event network-vif-plugged:e33030b9-6c9e-4361-9911-d23fdfcce223 for instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 on hv-cinder-83699 May 09 20:27:18.744535 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-85141d75-fc75-438e-a9d1-592f8d15bbb4 req-c079953e-2889-4da4-b521-adf1cd2f8361 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028854 May 09 20:27:18.745113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 149/337] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:27:19.127767 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:19.128397 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:19.134987 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:19.135462 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:19.136230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:19.136927 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:19.260298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:19.267766 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fee18b21-c124-4ba0-804b-a71cdfddc85e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1319 microversion: 2.1 time: 0.143907 May 09 20:27:19.268327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 189/338] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:19 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:19.501498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:19.502200 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:19.508328 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:19.508769 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:19.509540 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:19.509955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:19.636564 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:19.643715 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7c697ad9-c4ec-47f6-a5ed-54cd8d9ff758 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.146818 May 09 20:27:19.644267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 150/339] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:19 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:20.283594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:20.284232 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:20.290434 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:20.290884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:20.291676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:20.292107 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:20.427475 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:20.435367 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7f807260-5d79-4ab4-8dcd-15ebc5d0ea89 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1319 microversion: 2.1 time: 0.155621 May 09 20:27:20.435944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 190/340] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:20 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:20.660858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:20.661462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:20.667958 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:20.668401 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:20.669156 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:20.669583 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:20.811319 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:20.818706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a52ba74c-5cea-4629-8a66-3a0ec09d52ec tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.161652 May 09 20:27:20.819310 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 151/341] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:20 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:21.452024 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:21.453451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:21.459540 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:21.459982 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:21.461582 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:21.462079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:21.591424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:21.598928 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-555502d1-0ae1-4ffa-92f8-c3481b6717dc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1319 microversion: 2.1 time: 0.150740 May 09 20:27:21.599540 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 191/342] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:21 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:21.835530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:21.836735 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:21.842876 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:21.843320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:21.844105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:21.844532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:22.044380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:22.051548 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-dc22486a-4e8c-477b-a0a5-e25ad0ec84c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.219856 May 09 20:27:22.052111 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 152/343] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:21 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:22.615775 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:22.616535 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:22.624011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:22.624459 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:22.625359 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:22.625785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:22.740599 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-8a593b3f-d306-438d-a523-d2a8059a262a req-a61378d2-3248-4cda-8e38-2644e69f52f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf", "name": "network-vif-plugged", "status": "completed", "tag": "474292af-32d0-4620-aeed-ccf48a0c7f15"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:22.748443 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-8a593b3f-d306-438d-a523-d2a8059a262a req-a61378d2-3248-4cda-8e38-2644e69f52f4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:22.749209 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-8a593b3f-d306-438d-a523-d2a8059a262a req-a61378d2-3248-4cda-8e38-2644e69f52f4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:22.762294 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:22.763057 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-8a593b3f-d306-438d-a523-d2a8059a262a req-a61378d2-3248-4cda-8e38-2644e69f52f4 service nova] Creating event network-vif-plugged:474292af-32d0-4620-aeed-ccf48a0c7f15 for instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf on hv-cinder-83699 May 09 20:27:22.768180 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-8a593b3f-d306-438d-a523-d2a8059a262a req-a61378d2-3248-4cda-8e38-2644e69f52f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031111 May 09 20:27:22.769303 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 153/344] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:27:22.770873 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fc3cd93b-722a-46fd-8d82-2f213d583719 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1319 microversion: 2.1 time: 0.158888 May 09 20:27:22.774298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 192/345] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:22 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:23.070729 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:23.071436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:23.077432 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:23.077892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:23.078644 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:23.079092 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:23.202759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:23.209792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-05cf0007-88ed-4132-9897-66aff66c56e2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1371 microversion: 2.1 time: 0.144254 May 09 20:27:23.210338 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 154/346] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:23 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:23.787790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:23.788409 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:23.794889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:23.795363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:23.796155 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:23.796587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:23.925787 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:23.933821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ca7b1fa5-c46f-4043-bf16-09e81883805e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1319 microversion: 2.1 time: 0.149913 May 09 20:27:23.934394 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 193/347] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:23 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:27:24.228859 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:24.229904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:24.240118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:24.240868 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:24.242027 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:24.242540 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:24.365842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:24.373260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-96f1682a-6f47-41b0-931f-0da20c1e9c4c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1565 microversion: 2.1 time: 0.150046 May 09 20:27:24.373814 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 155/348] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:24 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:24.391726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5b6a07be-16ff-45b8-a71d-72ab5448c528 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:24.392253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5b6a07be-16ff-45b8-a71d-72ab5448c528 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:24.398742 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b6a07be-16ff-45b8-a71d-72ab5448c528 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:24.399181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b6a07be-16ff-45b8-a71d-72ab5448c528 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:24.399961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b6a07be-16ff-45b8-a71d-72ab5448c528 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:24.400388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b6a07be-16ff-45b8-a71d-72ab5448c528 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:24.477022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5b6a07be-16ff-45b8-a71d-72ab5448c528 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090266 May 09 20:27:24.477608 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 194/349] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:27:24 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:27:24.951477 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:24.952041 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:24.958201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:24.958640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:24.959423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:24.959866 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:25.096526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:27:25.104236 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1e832ae3-8780-4fad-84a7-91217a3b324a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1509 microversion: 2.1 time: 0.156744 May 09 20:27:25.104900 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 156/350] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:27:24 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:27:25.690258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-0dabf371-9dd8-48ed-bcb3-445a4b1acebf req-f64d17c0-92f4-4257-b77b-f3dc84779b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51484383-fe65-4cb3-9ed3-d42efa4bc5f9", "tag": "e33030b9-6c9e-4361-9911-d23fdfcce223"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:25.698440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0dabf371-9dd8-48ed-bcb3-445a4b1acebf req-f64d17c0-92f4-4257-b77b-f3dc84779b10 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:25.698876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0dabf371-9dd8-48ed-bcb3-445a4b1acebf req-f64d17c0-92f4-4257-b77b-f3dc84779b10 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:25.711077 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-0dabf371-9dd8-48ed-bcb3-445a4b1acebf req-f64d17c0-92f4-4257-b77b-f3dc84779b10 service nova] Creating event network-changed:e33030b9-6c9e-4361-9911-d23fdfcce223 for instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 on hv-cinder-83699 May 09 20:27:25.716979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-0dabf371-9dd8-48ed-bcb3-445a4b1acebf req-f64d17c0-92f4-4257-b77b-f3dc84779b10 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030262 May 09 20:27:25.718390 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 195/351] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:27:49.634518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9ac7fa7c-3a60-4c77-845e-7767cdc208ce tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01809c34-9804-408f-b393-4e33aa43b650", "device": "/dev/sdb"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:27:49.636542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9ac7fa7c-3a60-4c77-845e-7767cdc208ce tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:49.642479 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac7fa7c-3a60-4c77-845e-7767cdc208ce tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:49.642923 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac7fa7c-3a60-4c77-845e-7767cdc208ce tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:49.643700 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac7fa7c-3a60-4c77-845e-7767cdc208ce tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:49.644128 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ac7fa7c-3a60-4c77-845e-7767cdc208ce tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:49.874355 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9ac7fa7c-3a60-4c77-845e-7767cdc208ce tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "POST /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243716 May 09 20:27:49.874953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 157/352] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:27:49 2022] POST /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:27:59.815623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6066f5f9-5106-4ed3-993a-ea53cad7d189 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:27:59.816135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6066f5f9-5106-4ed3-993a-ea53cad7d189 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:27:59.822214 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6066f5f9-5106-4ed3-993a-ea53cad7d189 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:59.823266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6066f5f9-5106-4ed3-993a-ea53cad7d189 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:59.824081 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6066f5f9-5106-4ed3-993a-ea53cad7d189 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:27:59.824543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6066f5f9-5106-4ed3-993a-ea53cad7d189 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:27:59.847925 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6066f5f9-5106-4ed3-993a-ea53cad7d189 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/ips" status: 200 len: 149 microversion: 2.1 time: 0.036591 May 09 20:27:59.848485 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 196/353] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:27:59 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:00.704561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:28:00.704778 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:28:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:28:01.139893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0af817fb-576c-45af-a050-ebae096a95cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:01.140465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0af817fb-576c-45af-a050-ebae096a95cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:01.146423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0af817fb-576c-45af-a050-ebae096a95cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:01.146865 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0af817fb-576c-45af-a050-ebae096a95cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:01.147653 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0af817fb-576c-45af-a050-ebae096a95cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:01.148077 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0af817fb-576c-45af-a050-ebae096a95cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:01.171901 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0af817fb-576c-45af-a050-ebae096a95cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/ips" status: 200 len: 153 microversion: 2.20 time: 0.036908 May 09 20:28:01.172467 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 158/354] 10.222.0.44 () {60 vars in 1288 bytes} [Mon May 9 20:28:01 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:28:03.271624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5813a2b8-392c-463d-ad96-5dc20720e5c1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e08b9500-1329-4b86-a131-a7ed468112ff"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:03.272735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5813a2b8-392c-463d-ad96-5dc20720e5c1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:03.279094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5813a2b8-392c-463d-ad96-5dc20720e5c1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:03.279564 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5813a2b8-392c-463d-ad96-5dc20720e5c1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:03.280319 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5813a2b8-392c-463d-ad96-5dc20720e5c1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:03.280745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5813a2b8-392c-463d-ad96-5dc20720e5c1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:03.537603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5813a2b8-392c-463d-ad96-5dc20720e5c1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269823 May 09 20:28:03.538554 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 197/355] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:28:03 2022] POST /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:05.071038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:05.071609 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:05.078229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:05.078670 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:05.079444 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:05.079873 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:05.103596 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lazy-loading 'flavor' on Instance uuid 425e8732-2c2b-4c37-b2c3-e766712d293f {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:28:05.287152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0e9ade65-2b79-420a-bddc-8581dc429878 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:05.287748 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0e9ade65-2b79-420a-bddc-8581dc429878 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:05.295015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9ade65-2b79-420a-bddc-8581dc429878 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:05.295478 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9ade65-2b79-420a-bddc-8581dc429878 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:05.296352 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9ade65-2b79-420a-bddc-8581dc429878 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:05.296782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e9ade65-2b79-420a-bddc-8581dc429878 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:05.320309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0e9ade65-2b79-420a-bddc-8581dc429878 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/ips" status: 200 len: 145 microversion: 2.1 time: 0.037277 May 09 20:28:05.320881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 198/356] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:28:05 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:28:05.361897 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-17208407-6aed-43b6-877d-8e0210187ccb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/action" status: 202 len: 0 microversion: 2.20 time: 0.294823 May 09 20:28:05.362515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 159/357] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 20:28:05 2022] POST /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 20:28:05.371131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:05.371781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:05.377840 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:05.378283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:05.379045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:05.379489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:05.510380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:05.518913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:05.520486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:05.521548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0dcbdae8-79ce-411c-98a0-98d2de9f9935 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.154876 May 09 20:28:05.522097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 199/358] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:05 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:06.542583 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:06.543461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:06.549634 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:06.550080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:06.550839 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:06.551273 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:06.682372 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:06.691032 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:06.692552 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:06.693691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-990e6498-655e-4f09-ae2d-5edadf22bd02 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.156466 May 09 20:28:06.694244 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 160/359] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:06 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:07.712508 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:07.713115 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:07.719995 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:07.720444 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:07.721217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:07.721650 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:07.848795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:07.856361 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:07.857886 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:07.859028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e078665a-1a36-424f-b20e-617c2ae47bc0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.150437 May 09 20:28:07.859613 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 200/360] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:07 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:08.876551 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:08.877190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:08.883509 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:08.883947 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:08.884691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:08.885125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:09.021802 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:09.030673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:09.032424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:09.033593 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ce75313a-9099-45c6-8efd-51092efb9827 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.160957 May 09 20:28:09.034145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 161/361] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:08 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:10.052011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:10.052524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:10.058802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:10.059240 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:10.060019 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:10.060445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:10.188097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:10.195714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:10.197190 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:10.198821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-01f6f394-2118-440d-b93e-d67ebebab978 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.150228 May 09 20:28:10.199444 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 201/362] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:10 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:11.217152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:11.217759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:11.224082 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:11.224526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:11.225283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:11.225717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:11.355081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:11.362734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:11.364289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:11.365470 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3711d72a-a35b-4f55-b600-0d8594b370cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.152117 May 09 20:28:11.365973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 162/363] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:11 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:12.383968 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:12.384571 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:12.391551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:12.392006 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:12.392756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:12.393181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:12.523616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:12.531960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:12.533440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:12.534583 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c46097d1-d9c6-40a7-b2b1-6cf0c6ede5e4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.154414 May 09 20:28:12.535144 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 202/364] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:12 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:13.553244 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:13.553853 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:13.560677 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:13.561120 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:13.561883 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:13.562311 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:13.689210 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:13.696836 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:13.698951 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:13.700117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e391535c-602a-45f6-9aab-a011cc1bf5f2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.150795 May 09 20:28:13.700672 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 163/365] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:13 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:14.718655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:14.719267 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:14.725653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:14.726099 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:14.726856 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:14.727284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:14.856489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:14.864388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:14.865877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:14.867030 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-96e1b4f6-89b3-4b1c-bdea-ffedf4ddd091 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.152427 May 09 20:28:14.867716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 203/366] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:14 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:15.001888 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-43b156d5-69fa-46b8-a743-007dd96f8fd0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df445f7-2270-4bec-b4f2-70355f1d5812"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:15.003083 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-43b156d5-69fa-46b8-a743-007dd96f8fd0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:15.009301 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43b156d5-69fa-46b8-a743-007dd96f8fd0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:15.009748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43b156d5-69fa-46b8-a743-007dd96f8fd0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:15.011042 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43b156d5-69fa-46b8-a743-007dd96f8fd0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:15.011780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43b156d5-69fa-46b8-a743-007dd96f8fd0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:15.612461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-43b156d5-69fa-46b8-a743-007dd96f8fd0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614029 May 09 20:28:15.613059 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 164/367] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:28:14 2022] POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:15.885839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:15.886698 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:15.893035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:15.893477 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:15.894381 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:15.894859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:16.024268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:16.034054 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:16.035600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:16.036764 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0b2d3a0a-5e75-474f-a509-b4a1918e383c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.155108 May 09 20:28:16.037323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 204/368] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:15 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:16.264834 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2f468056-acd7-4381-a6ee-5deaf7870e02 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: .version_select at 0x7f62bcd75e50>, body: {"keypair": {"name": "tempest-keypair-663307979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfc3OIIHb9Y5yPeUsgunpKuBoF1pz/HyQfEjOFkaR/dhxBPVsH9aHczU7KX5yBM2HUZ0P1bE+koGWvGRKAnsmRqHJFwdZUdMyR39Fe4o27vVGtH1Pjo6KbVQHXyzRMpnA=="}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:16.279441 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-2f468056-acd7-4381-a6ee-5deaf7870e02 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:28:16.283284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-2f468056-acd7-4381-a6ee-5deaf7870e02 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:28:16.305789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2f468056-acd7-4381-a6ee-5deaf7870e02 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045962 May 09 20:28:16.306362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 165/369] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:28:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:17.056327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:17.057096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:17.063597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:17.064126 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:17.064891 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:17.065320 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:17.201819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:17.209800 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:17.211274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:17.212441 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-28a29776-063c-4b0f-b935-e052b4f56728 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.160027 May 09 20:28:17.212983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 205/370] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:17 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:17.539999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:17.540748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:17.547620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:17.548423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:17.548829 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:17.549258 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:17.574610 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-604752974", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faed6f7c-f550-49ae-a092-e26879c69bec"}], "security_groups": [{"name": "tempest-securitygroup--1569260072"}], "key_name": "tempest-keypair-663307979", "user_data": "}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:17.675547 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lazy-loading 'services' on Instance uuid cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:28:17.676646 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] validate_networks() for [('faed6f7c-f550-49ae-a092-e26879c69bec', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:28:17.791493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-79d02e4c-8373-46a0-9c4d-99685dd32f1b tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf/os-volume_attachments/01809c34-9804-408f-b393-4e33aa43b650" status: 202 len: 0 microversion: 2.1 time: 0.255727 May 09 20:28:17.792297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 166/371] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:28:17 2022] DELETE /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf/os-volume_attachments/01809c34-9804-408f-b393-4e33aa43b650 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:28:18.066710 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:28:18.067195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:28:18.067644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:28:18.068052 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:28:18.068462 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:28:18.077561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:18.078036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:18.078842 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:18.079274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:18.095321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:28:18.099188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:28:18.109916 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:28:18.112179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:28:18.158511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-59a0bcae-e6d3-4145-bfd9-372681b50d0d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588268 May 09 20:28:18.159241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 206/372] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:28:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 20:28:18.170613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-af314662-56ac-4bd0-9a1a-c484e24dbf10 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:18.171422 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-af314662-56ac-4bd0-9a1a-c484e24dbf10 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:18.230734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-af314662-56ac-4bd0-9a1a-c484e24dbf10 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:18.233325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:18.234994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:18.238618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-af314662-56ac-4bd0-9a1a-c484e24dbf10 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1240 microversion: 2.1 time: 0.073277 May 09 20:28:18.239249 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 167/373] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:18 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:18.242597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:18.243041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:18.243848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:18.244286 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:18.376376 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:18.384240 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:18.386764 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:18.387954 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9a9dc0b1-fbdb-425d-b844-ced90ab63e33 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.160283 May 09 20:28:18.388511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 207/374] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:18 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:19.255911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:19.256504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:19.263560 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:19.264003 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:19.264757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:19.265181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:19.352025 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:19.360162 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-995f1814-ae5f-4b9d-a91d-cd45899a759d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1300 microversion: 2.1 time: 0.108173 May 09 20:28:19.360932 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 168/375] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:19 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:19.406151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:19.406888 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:19.414037 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:19.414726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:19.415716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:19.416156 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:19.550920 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:19.558843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:19.560366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:19.561523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-acdf37dc-500e-4b08-9d5b-c1445b0820e6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.159372 May 09 20:28:19.562087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 208/376] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:19 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:20.376842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:20.377541 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:20.384086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:20.384529 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:20.385303 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:20.385776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:20.580914 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:20.582575 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:20.598667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:20.598856 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:20.599299 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:20.600093 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:20.600687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:20.619368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a2cfca3c-16fe-4305-b1b3-2002f918eb39 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.246267 May 09 20:28:20.622793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 169/377] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:20 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:20.757503 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:20.768420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:20.769914 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:20.771435 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d9af4512-8ec1-4b47-9438-f95503822394 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.195167 May 09 20:28:20.772001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 209/378] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:20 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:20.824225 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-a59ad4f3-f051-4261-a882-f2191ff90f8e req-7f446dae-a171-419d-a1f0-983555000ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c597e2ce-b43c-488d-95b1-dbabe035c2b5", "tag": "8210b103-2ad6-4969-8f18-c129db8dd1a3"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:20.833481 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-a59ad4f3-f051-4261-a882-f2191ff90f8e req-7f446dae-a171-419d-a1f0-983555000ec7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:20.834320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-a59ad4f3-f051-4261-a882-f2191ff90f8e req-7f446dae-a171-419d-a1f0-983555000ec7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:20.852770 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-a59ad4f3-f051-4261-a882-f2191ff90f8e req-7f446dae-a171-419d-a1f0-983555000ec7 service nova] Creating event network-changed:8210b103-2ad6-4969-8f18-c129db8dd1a3 for instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 on hv-cinder-83699 May 09 20:28:20.858324 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-a59ad4f3-f051-4261-a882-f2191ff90f8e req-7f446dae-a171-419d-a1f0-983555000ec7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037873 May 09 20:28:20.859288 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 170/379] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:21.639317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:21.639963 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:21.646296 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:21.646742 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:21.647534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:21.647974 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:21.782220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:21.789885 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-103a7ed9-ae8c-4b64-992a-91966ac965c7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.155604 May 09 20:28:21.790444 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 210/380] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:21 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:21.790758 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:21.791482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:21.797757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:21.798192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:21.798951 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:21.799376 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:21.942682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:21.951621 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:21.953329 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:21.954514 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-951bcaa0-0027-4fe4-bf22-1b902d407029 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.168423 May 09 20:28:21.955082 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 171/381] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:21 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:22.806184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:22.806789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:22.816765 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:22.817202 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:22.817985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:22.818410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:22.948244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:22.955543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d4b70cd7-b2ea-4cf3-a73b-9f22b13b3347 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.153118 May 09 20:28:22.956099 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 211/382] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:22 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:22.972743 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:22.973361 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:22.979930 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:22.980374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:22.981182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:22.981614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:23.115693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:23.123797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:23.125293 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:23.126441 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8cb0683f-22bf-44c9-862a-2942f6176671 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.157551 May 09 20:28:23.126979 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 172/383] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:22 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:23.973184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:23.973826 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:23.980861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:23.981321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:23.982076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:23.982510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:24.109469 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:24.116641 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fd3212da-ef9d-45ed-966c-d2502e99c0d7 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.147322 May 09 20:28:24.117201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 212/384] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:23 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:24.145420 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:24.146018 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:24.152657 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:24.153081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:24.153837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:24.154262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:24.278814 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:24.286402 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:24.287910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:24.289061 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-23eae63c-55ea-4056-8961-9c064d52841a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.147464 May 09 20:28:24.289591 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 173/385] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:24 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:25.133660 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:25.134295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:25.141519 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:25.141968 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:25.142724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:25.143152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:25.273949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:25.281607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f8b9298b-c51e-455e-9da6-9184564e3a88 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.151761 May 09 20:28:25.282157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 213/386] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:25 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:25.307571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:25.308179 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:25.314117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:25.314563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:25.315318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:25.315796 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:25.445214 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:25.453433 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:25.454920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:25.456086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7164b71d-b3b2-4015-96ea-459cd86b2411 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.152397 May 09 20:28:25.456633 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 174/387] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:25 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:26.298545 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:26.299150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:26.305604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:26.306058 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:26.306809 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:26.307450 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:26.432648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:26.439943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-91275230-e654-456f-8ed1-d928f78539b4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.145164 May 09 20:28:26.440510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 214/388] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:26 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:26.474891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:26.475552 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:26.483219 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:26.484054 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:26.484838 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:26.485272 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:26.661858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:26.669778 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:26.671300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:26.672474 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-49d6511c-e34b-4ff5-91ae-f927d66ff91b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1746 microversion: 2.20 time: 0.201494 May 09 20:28:26.673029 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 175/389] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:26 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:27.318303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3c81111a-5e6b-4f06-8c95-346f61443306 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:27.324811 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c81111a-5e6b-4f06-8c95-346f61443306 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:27.325256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c81111a-5e6b-4f06-8c95-346f61443306 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:27.388367 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3c81111a-5e6b-4f06-8c95-346f61443306 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Going to try to stop instance {{(pid=116849) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 20:28:27.437104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3c81111a-5e6b-4f06-8c95-346f61443306 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action" status: 202 len: 0 microversion: 2.1 time: 0.122507 May 09 20:28:27.438023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 215/390] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:28:27 2022] POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:28:27.446077 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:27.446826 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:27.455246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:27.456510 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:27.457345 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:27.457813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:27.465110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:27.465825 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:27.472898 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:27.473348 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:27.474218 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:27.474959 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:27.606739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:27.614630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5710d8ef-b1ee-42a2-a885-662048c4c6cf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.172379 May 09 20:28:27.615268 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 176/391] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:27 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:27.617076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:27.624594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-254919d8-31c7-48b6-8e80-a9d70005ddac tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.169380 May 09 20:28:27.625144 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 216/392] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:27 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:27.691083 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:27.691714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:27.697480 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:27.698421 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:27.699175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:27.699623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:27.832461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:27.840013 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:27.841506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:27.842658 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-74daad5d-686d-4406-bd74-19222b52e12d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1746 microversion: 2.20 time: 0.155395 May 09 20:28:27.843213 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 177/393] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:27 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:28.409205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:28.409751 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:28.415922 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.417028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.417942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.418372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.443433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:28:28.533365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-afbe20c6-4db7-4add-ae46-e121d3b6f916 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 204 len: 0 microversion: 2.1 time: 0.127374 May 09 20:28:28.533952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 217/394] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:28:28 2022] DELETE /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:28:28.542554 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:28.543162 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:28.549359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.549800 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.550563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.550975 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.633422 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:28.634152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:28.640791 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.641241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.642006 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.642439 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.688169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:28.695334 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c5a1236d-d422-4f65-af43-0e3eb75b9284 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1515 microversion: 2.1 time: 0.157214 May 09 20:28:28.695918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 178/395] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:28 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:28.700304 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:28.700903 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:28.706396 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.706831 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.707617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.708043 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.780811 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:28.788864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a9278043-f401-4d54-881e-3f72e3486992 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.159616 May 09 20:28:28.789622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 218/396] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:28 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:28.843084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:28.850370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-687ecc1c-749b-4f68-b749-708171704a16 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.153518 May 09 20:28:28.850944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 179/397] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:28 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:28.861163 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:28.861924 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:28.867774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.868217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:28.868974 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:28.869405 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.004254 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:29.012281 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:29.013769 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:29.014923 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-99a7e179-4dc4-41de-a561-5284198180d7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1746 microversion: 2.20 time: 0.157621 May 09 20:28:29.015510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 219/398] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:28 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:29.033033 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-ef919a19-ece3-40ff-b74d-87b09ba1b51f req-fab8bbef-b8b6-4b33-9870-69b62917cc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425e8732-2c2b-4c37-b2c3-e766712d293f", "name": "network-vif-plugged", "status": "completed", "tag": "9d1946fe-d370-43ff-a7d4-5a7d9c20d2be"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:29.040795 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-ef919a19-ece3-40ff-b74d-87b09ba1b51f req-fab8bbef-b8b6-4b33-9870-69b62917cc33 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:29.041234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-ef919a19-ece3-40ff-b74d-87b09ba1b51f req-fab8bbef-b8b6-4b33-9870-69b62917cc33 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.055890 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-ef919a19-ece3-40ff-b74d-87b09ba1b51f req-fab8bbef-b8b6-4b33-9870-69b62917cc33 service nova] Creating event network-vif-plugged:9d1946fe-d370-43ff-a7d4-5a7d9c20d2be for instance 425e8732-2c2b-4c37-b2c3-e766712d293f on hv-cinder-83699 May 09 20:28:29.061922 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-ef919a19-ece3-40ff-b74d-87b09ba1b51f req-fab8bbef-b8b6-4b33-9870-69b62917cc33 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032562 May 09 20:28:29.062515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 180/399] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:29.712858 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:29.714178 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:29.720298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:29.720738 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.721494 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:29.721919 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.807651 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:29.808354 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:29.815004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:29.815489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.816261 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:29.816694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.855244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:29.862762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d9bf299c-2b2a-4711-89ed-9d8827c66a77 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1515 microversion: 2.1 time: 0.153694 May 09 20:28:29.863342 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 220/400] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:29 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:29.867992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:29.868737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:29.876985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:29.877433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.878197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:29.878750 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:29.950139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:29.958074 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-19f346a0-50ee-4074-905c-46455f887515 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.154881 May 09 20:28:29.959340 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 181/401] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:29 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:30.009360 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:30.017360 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a0c1bc77-fe93-4899-ae12-f81f9839a692 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.153071 May 09 20:28:30.017916 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 221/402] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:29 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:30.033637 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:30.034247 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:30.040045 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:30.040494 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:30.041287 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:30.041912 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:30.174175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:30.181835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:30.183957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:30.185093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-958eb74a-f8bf-48b1-a662-ce5a6d975375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1746 microversion: 2.20 time: 0.155317 May 09 20:28:30.185641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 182/403] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:30 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:30.879948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:30.880559 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:30.887139 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:30.887607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:30.888359 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:30.888788 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:30.976296 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:30.977689 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:30.984986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:30.985508 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:30.986276 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:30.986708 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:31.020227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:31.028012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c0c473a6-b37c-4f03-8cbe-1a1d4a54f29c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1515 microversion: 2.1 time: 0.151843 May 09 20:28:31.028789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 222/404] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:30 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:31.035162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:31.035801 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:31.042087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:31.042523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:31.043427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:31.043860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:31.118064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:31.125973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2aa1a0b4-f40d-4df5-a7c7-a6f0a156b5b4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.153805 May 09 20:28:31.126538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 183/405] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:30 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:31.170009 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:31.177089 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-88ba8240-4df2-4560-8095-722354b228ee tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.145696 May 09 20:28:31.177644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 223/406] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:31 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:31.203973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:31.204592 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:31.210403 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:31.210847 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:31.211641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:31.212080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:31.372344 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:31.380157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:31.381658 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:31.382809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-52e3a205-d6a1-47c7-9964-1dd74a87fc9c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1746 microversion: 2.20 time: 0.182954 May 09 20:28:31.383362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 184/407] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:31 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:31.669861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-0dea9ea6-b44e-4608-94b0-4a312f6036c2 req-7c95c7cd-a03e-4b15-8ab3-0a953bf869b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c597e2ce-b43c-488d-95b1-dbabe035c2b5", "name": "network-vif-plugged", "status": "completed", "tag": "8210b103-2ad6-4969-8f18-c129db8dd1a3"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:31.680635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0dea9ea6-b44e-4608-94b0-4a312f6036c2 req-7c95c7cd-a03e-4b15-8ab3-0a953bf869b3 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:31.681176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0dea9ea6-b44e-4608-94b0-4a312f6036c2 req-7c95c7cd-a03e-4b15-8ab3-0a953bf869b3 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:31.693874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-0dea9ea6-b44e-4608-94b0-4a312f6036c2 req-7c95c7cd-a03e-4b15-8ab3-0a953bf869b3 service nova] Creating event network-vif-plugged:8210b103-2ad6-4969-8f18-c129db8dd1a3 for instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 on hv-cinder-83699 May 09 20:28:31.699627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-0dea9ea6-b44e-4608-94b0-4a312f6036c2 req-7c95c7cd-a03e-4b15-8ab3-0a953bf869b3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034083 May 09 20:28:31.700690 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 224/408] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:32.044833 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:32.045369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:32.051838 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.052281 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.053066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.053516 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.145061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:32.145874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:32.152470 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.152922 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.153693 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.154131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.287136 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:32.295255 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-92e2596e-cf7b-4ff5-bf69-97243baead07 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.154750 May 09 20:28:32.295792 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 225/409] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:32 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:32.300159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:32.300767 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:32.306754 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.307823 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.308633 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.309067 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.337097 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:32.345502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-47a33dee-249c-497b-81ab-67ebaf6704ed tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1515 microversion: 2.1 time: 0.304456 May 09 20:28:32.346082 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 185/410] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:32 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:32.401423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:32.402343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:32.408961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.409663 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.410633 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.411254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.465464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:32.472802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f1423129-2484-4888-b7c6-7a0b2b2fa095 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.176008 May 09 20:28:32.473384 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 226/411] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:32 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:32.518131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-7ab28303-c8e7-4b28-94e2-807d16203bd4 req-0451ac8f-339c-4170-b18a-1aab90bf2399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf", "name": "network-vif-deleted", "tag": "474292af-32d0-4620-aeed-ccf48a0c7f15"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:32.525886 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-7ab28303-c8e7-4b28-94e2-807d16203bd4 req-0451ac8f-339c-4170-b18a-1aab90bf2399 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:32.526330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-7ab28303-c8e7-4b28-94e2-807d16203bd4 req-0451ac8f-339c-4170-b18a-1aab90bf2399 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:32.537252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-7ab28303-c8e7-4b28-94e2-807d16203bd4 req-0451ac8f-339c-4170-b18a-1aab90bf2399 service nova] Creating event network-vif-deleted:474292af-32d0-4620-aeed-ccf48a0c7f15 for instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf on hv-cinder-83699 May 09 20:28:32.542202 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-7ab28303-c8e7-4b28-94e2-807d16203bd4 req-0451ac8f-339c-4170-b18a-1aab90bf2399 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027568 May 09 20:28:32.542782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 227/412] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:28:32.577776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:32.585470 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:32.586961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:32.588192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-238410b9-1465-4e45-a0ad-958ff66f973a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1746 microversion: 2.20 time: 0.190554 May 09 20:28:32.588746 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 186/413] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:32 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1746 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:33.313375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:33.314074 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:33.320198 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.320651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.321404 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.321835 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.361899 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:33.362875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:33.369236 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.369677 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.370624 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.371050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.401947 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.402382 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.402826 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lazy-loading 'fault' on Instance uuid cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:28:33.445518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:33.452708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:33.453426 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e3221a58-fdc2-4028-8645-84bbddc8bbf0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 200 len: 1309 microversion: 2.1 time: 0.095315 May 09 20:28:33.453997 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 187/414] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:33 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:33.460509 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2d8fe19e-d709-472b-ab22-4e2d194bb6e7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.151762 May 09 20:28:33.461053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 228/415] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:33 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:33.488868 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:33.489502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:33.495749 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.496189 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.496939 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.497361 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.606493 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:33.607238 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:33.613020 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.613536 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.614364 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:33.614866 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:33.626652 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:33.634086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-021c1c32-4357-4134-8554-8fe92c440287 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1366 microversion: 2.1 time: 0.148996 May 09 20:28:33.634721 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 188/416] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:33 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:33.745802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:33.753392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:33.754901 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:33.756081 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a2436dab-9056-4d27-951f-d95c6f2e386d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1746 microversion: 2.20 time: 0.153751 May 09 20:28:33.756633 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 229/417] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:33 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:34.470218 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:34.470832 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:34.477447 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.477887 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.478072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:34.479144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.479291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:34.479678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.485586 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.486036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.486819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.487246 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.492660 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] HTTP exception thrown: Instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf could not be found. May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Request method failure captured: May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf HTTP/1.1 May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXkfysEutSbGwH-OdK2WleRYLaGx8sLPwb7y7kADuW74kBdLdMSsj-Q-gtbVv6ZUiA7LDz-wYK2Kv0QvodYKIAHYhyP62k3LIJ7OHC3BYm-1qZz4TAzJ3HBEcNfsnZ2O8_8f4v0_fsiXo1J3M5VZOZ-5aHLn_VF9EYN2dLIr7QfsbSo May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 970fffc753884be893292412dc3a6f69 May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesSnapshotTestJSON-432389011 May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:28:34.495292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/970fffc753884be893292412dc3a6f69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_970fffc753884be893292412dc3a6f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/970fffc753884be893292412dc3a6f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/970fffc753884be893292412dc3a6f69"}]}] May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesSnapshotTestJSON-432389011 May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 970fffc753884be893292412dc3a6f69 May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-432389011 May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesSnapshotTestJSON-432389011-project May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 3e50a700ac8f4e708b23e35ffa57e4cf May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesSnapshotTestJSON-432389011-project May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf could not be found. May 09 20:28:34.496799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf'} May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf could not be found. May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:28:34.497567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf could not be found. May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf could not be found. May 09 20:28:34.499816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:28:34.501428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Returning 404 to user: Instance cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:28:34.501428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1499bb86-2603-4b42-bb25-4ee1fba75441 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf" status: 404 len: 111 microversion: 2.1 time: 0.030391 May 09 20:28:34.501428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 189/418] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:34 2022] GET /compute/v2.1/servers/cbd45c0a-9469-4642-8dd5-1e5cd33b9ddf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:28:34.653117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:34.653927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:34.661077 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.661458 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.665050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:34.668375 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.668985 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.682345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b91be0b6-ccd2-4e5c-8a6e-d6ebdb97c190 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.207979 May 09 20:28:34.683193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 230/419] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:34 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:34.775118 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:34.776237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:34.781958 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.782379 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.783126 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.783578 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.806159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:34.814057 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8f6de856-0b9e-4b4f-89f0-00425979e4cb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1555 microversion: 2.1 time: 0.165592 May 09 20:28:34.814719 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 190/420] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:34 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:34.831583 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4181c7dd-8681-4f27-9503-a972b85cdd48 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:34.832123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4181c7dd-8681-4f27-9503-a972b85cdd48 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:34.840922 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4181c7dd-8681-4f27-9503-a972b85cdd48 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.841511 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4181c7dd-8681-4f27-9503-a972b85cdd48 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.842353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4181c7dd-8681-4f27-9503-a972b85cdd48 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:34.842792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4181c7dd-8681-4f27-9503-a972b85cdd48 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:34.916487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:34.922206 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4181c7dd-8681-4f27-9503-a972b85cdd48 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094622 May 09 20:28:34.922796 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 191/421] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:28:34 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:28:34.924683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:34.926206 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:34.927361 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2826f394-c4d4-43d7-9dc0-9c993bd5beb2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.156148 May 09 20:28:34.927930 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 231/422] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:34 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:35.700544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:35.701313 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:35.708835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:35.708835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:35.708835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:35.709219 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:35.901517 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:35.909572 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-057c226c-2310-4c75-9b4b-e8ca3195d09a tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.213498 May 09 20:28:35.910282 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 192/423] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:35 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:35.945633 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:35.946654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:35.953574 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:35.954034 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:35.955102 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:35.955252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:35.989646 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-1ebe1aad-fdb0-4a29-9357-3696c5480dd5 req-181162f6-4fb8-434c-8a04-81e03258cbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c597e2ce-b43c-488d-95b1-dbabe035c2b5", "tag": "8210b103-2ad6-4969-8f18-c129db8dd1a3"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:35.999583 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-1ebe1aad-fdb0-4a29-9357-3696c5480dd5 req-181162f6-4fb8-434c-8a04-81e03258cbd5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:36.000024 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-1ebe1aad-fdb0-4a29-9357-3696c5480dd5 req-181162f6-4fb8-434c-8a04-81e03258cbd5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:36.013901 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-1ebe1aad-fdb0-4a29-9357-3696c5480dd5 req-181162f6-4fb8-434c-8a04-81e03258cbd5 service nova] Creating event network-changed:8210b103-2ad6-4969-8f18-c129db8dd1a3 for instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 on hv-cinder-83699 May 09 20:28:36.019479 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-1ebe1aad-fdb0-4a29-9357-3696c5480dd5 req-181162f6-4fb8-434c-8a04-81e03258cbd5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033411 May 09 20:28:36.020275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 193/424] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:28:36.090899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:36.098720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:36.100406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:36.101662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-177df1a6-32c8-4fd7-bcf1-7a6b424aeaa9 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.159854 May 09 20:28:36.102301 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 232/425] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:35 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:36.927155 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:36.927870 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:36.934739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:36.935179 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:36.935962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:36.936386 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:37.079195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:37.087243 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4fcb7ad6-3f1f-45db-bc5b-1e2cdc9aadf5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.164181 May 09 20:28:37.088423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 194/426] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:36 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:37.121064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:37.121604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:37.127955 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:37.128400 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:37.129162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:37.129591 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:37.258487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:37.266948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:37.268453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:37.269591 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8c219a2d-43b8-4553-b992-548135059571 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.152606 May 09 20:28:37.270139 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 233/427] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:37 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:38.105814 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:38.106422 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:38.112796 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:38.113239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:38.114002 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:38.114433 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:38.241166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:38.249818 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fe51e0fd-a482-40e6-9cdb-dd38d62f95b1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.148584 May 09 20:28:38.250419 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 195/428] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:38 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:38.288302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:38.288918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:38.295859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:38.296307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:38.297063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:38.297496 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:38.426153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:38.434338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:38.435854 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:38.437030 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-de0daec8-328b-4490-b25f-6dfb5f550f2e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.152615 May 09 20:28:38.437573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 234/429] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:38 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:39.267483 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:39.269091 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:39.278164 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:39.278686 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:39.279719 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:39.280359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:39.437262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:39.446001 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0a3598c4-d997-40d4-b4c7-09a19c796f5f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.182824 May 09 20:28:39.446596 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 196/430] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:39 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:39.460708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:39.461321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:39.470566 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:39.471229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:39.472119 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:39.472561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:39.623996 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:39.635720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:39.637622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:39.638860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f5d0ea11-a6c5-4bcf-8c83-1b143667029f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.182833 May 09 20:28:39.639679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 235/431] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:39 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:40.463750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:40.464962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:40.477937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:40.480360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:40.481564 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:40.482790 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:40.635650 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:40.644381 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-64ac07d2-d826-4b45-ad43-59d5cd29094b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.184701 May 09 20:28:40.644940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 197/432] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:40 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:40.657327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:40.658250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:40.664784 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:40.665612 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:40.679557 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:40.680695 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:40.907009 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:40.916271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:40.918110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:40.919286 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2f92d80d-754f-4268-a7bf-0212aeeb3070 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.265725 May 09 20:28:40.930266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 236/433] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:40 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:41.664108 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:41.664719 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:41.671664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:41.672110 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:41.672884 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:41.673315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:41.821533 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:41.830832 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-827c259e-7559-4b9b-984c-84bcdf4311ea tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.170517 May 09 20:28:41.832028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 198/434] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:41 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:41.937725 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:41.939245 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:41.946110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:41.946547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:41.947955 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:41.948700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:42.100280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:42.110173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:42.111782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:42.113143 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9a8fb2eb-25f1-4153-9c37-a5f9db3a2948 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.179343 May 09 20:28:42.114002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 237/435] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:41 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:42.852265 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:42.852814 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:42.859634 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:42.860241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:42.861020 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:42.861448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:43.008973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:43.018539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-60f277e4-ce98-437e-9c8e-d524c3059ee2 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.172587 May 09 20:28:43.029045 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 199/436] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:42 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:43.132345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:43.133684 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:43.143612 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:43.144165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:43.145140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:43.145598 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:43.311242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:43.323770 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:43.323770 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:43.323975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-45f38812-23d9-42be-962d-1522200ce54d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.195644 May 09 20:28:43.324586 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 238/437] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:43 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:44.036347 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:44.036960 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:44.043999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:44.044823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:44.045734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:44.046234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:44.212586 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:44.221828 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e7eeb686-0a29-42ec-997b-de9dba35a6c5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1723 microversion: 2.1 time: 0.189650 May 09 20:28:44.222617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 200/438] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:44 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:44.342571 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:44.344038 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:44.353009 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:44.353009 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:44.354242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:44.354645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:44.507771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:44.517700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:44.519195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:44.520486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-65b6f971-08f8-4623-9cfb-b91c84c52de5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.181926 May 09 20:28:44.527843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 239/439] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:44 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:45.240101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:45.241838 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:45.253100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:45.253874 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:45.254852 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:45.255281 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:45.400093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:45.409223 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-53103551-a753-4172-ae50-f67108ab5cb8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1700 microversion: 2.1 time: 0.174322 May 09 20:28:45.410085 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 201/440] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:45 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1700 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:45.426898 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d585a7de-6e9b-4e02-9134-744ab82a2cdb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:45.435836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d585a7de-6e9b-4e02-9134-744ab82a2cdb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:45.436417 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d585a7de-6e9b-4e02-9134-744ab82a2cdb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:45.459699 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d585a7de-6e9b-4e02-9134-744ab82a2cdb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Going to try to start instance {{(pid=116849) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 20:28:45.515587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d585a7de-6e9b-4e02-9134-744ab82a2cdb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action" status: 202 len: 0 microversion: 2.1 time: 0.092376 May 09 20:28:45.516279 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 240/441] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:28:45 2022] POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:28:45.525662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:45.526968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:45.535903 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:45.536633 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:45.537643 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:45.538290 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:45.543165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:45.544549 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:45.552593 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:45.553439 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:45.554303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:45.555043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:45.782681 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:45.797365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:45.799157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:45.800380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-15b79c45-141c-441e-ab4a-26698a725b47 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.264657 May 09 20:28:45.801328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 241/442] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:45 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:45.813867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:45.823005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fdb716d6-4b7c-4426-9ffe-ac2eb47982c8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1709 microversion: 2.1 time: 0.301810 May 09 20:28:45.824112 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 202/443] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:45 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1709 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:46.469284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1892328434", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "networks": [{"uuid": "f317edff-310d-49be-af90-086d8a71b534"}]}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:46.531796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] validate_networks() for [('f317edff-310d-49be-af90-086d8a71b534', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:28:46.823849 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:46.825482 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:46.832507 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:46.833145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:46.834111 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:46.834827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:46.941361 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:28:46.942073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:28:46.942706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:28:46.943250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:28:46.943859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:28:46.954803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:46.955259 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:46.956076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:46.956503 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:46.975121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Getting quotas for project 970fffc753884be893292412dc3a6f69. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:28:46.979808 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Getting quotas for user 3e50a700ac8f4e708b23e35ffa57e4cf and project 970fffc753884be893292412dc3a6f69. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:28:46.991459 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:28:46.993725 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:28:46.995954 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:47.005577 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:47.007622 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:47.009100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2d2d56f4-03a2-417b-9085-b05899add9f4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.189603 May 09 20:28:47.021439 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 203/444] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:46 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:47.021806 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:47.022683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:47.030726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:47.031311 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:47.032261 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:47.032828 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:47.044721 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-126479ca-44cd-495e-9ff3-7d4c446a4ee8 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579254 May 09 20:28:47.045360 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 242/445] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:28:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:28:47.058269 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-90d77e56-dffa-4d81-9b0c-f5218dc8822e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:47.059198 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-90d77e56-dffa-4d81-9b0c-f5218dc8822e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:47.129031 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-90d77e56-dffa-4d81-9b0c-f5218dc8822e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:47.139430 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-90d77e56-dffa-4d81-9b0c-f5218dc8822e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1219 microversion: 2.1 time: 0.086027 May 09 20:28:47.140210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 243/446] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:47 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:47.190080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:47.198925 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-31a9b8ee-3f6a-4945-837b-8056b2f39d6f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1709 microversion: 2.1 time: 0.181045 May 09 20:28:47.209734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 204/447] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:47 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1709 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:48.030841 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:48.031651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:48.039661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:48.040253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:48.041587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:48.041869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:48.156786 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:48.157532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:48.164502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:48.164955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:48.165734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:48.166463 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:48.218515 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:48.227930 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:48.230383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:48.231970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e70e6386-ba39-4425-b973-b6555a6f4e00 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.206788 May 09 20:28:48.233435 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 244/448] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:48 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:48.241089 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:48.241972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:48.247193 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:48.250310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:48.251011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:48.252545 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:48.255710 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:48.258949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4286081a-5c4a-4bee-a300-cf39c3806531 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1271 microversion: 2.1 time: 0.105911 May 09 20:28:48.260460 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 205/449] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:48 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:48.418514 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:48.426608 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-70130641-1507-4f33-ab6f-ca7912d6cbfd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1713 microversion: 2.1 time: 0.192137 May 09 20:28:48.438754 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 245/450] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:48 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1713 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:49.250651 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:49.251258 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:49.257093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:49.257540 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:49.258291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:49.258719 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:49.278508 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:49.279362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:49.286073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:49.286522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:49.287287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:49.287761 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:49.424513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:49.431676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ffb60958-95ac-4722-ac37-57abafb8f2a1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.157636 May 09 20:28:49.432253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 246/451] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:49 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:49.455516 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:49.464063 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:49.465609 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:49.466754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-56bd3fb9-0b8a-440e-bd7b-b92d430d54ba tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1741 microversion: 2.20 time: 0.220199 May 09 20:28:49.467302 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 206/452] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:49 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:49.946827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-7801675d-17cd-433c-ae7f-71403209fc52 req-f0edb23e-2208-42a0-8191-3ac989e0eb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077bf537-9e98-4c10-af59-354395ac91c4", "tag": "53c09941-9694-430a-bfb4-0ad45b3d5716"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:49.955185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-7801675d-17cd-433c-ae7f-71403209fc52 req-f0edb23e-2208-42a0-8191-3ac989e0eb63 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:49.955735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-7801675d-17cd-433c-ae7f-71403209fc52 req-f0edb23e-2208-42a0-8191-3ac989e0eb63 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:49.967797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-7801675d-17cd-433c-ae7f-71403209fc52 req-f0edb23e-2208-42a0-8191-3ac989e0eb63 service nova] Creating event network-changed:53c09941-9694-430a-bfb4-0ad45b3d5716 for instance 077bf537-9e98-4c10-af59-354395ac91c4 on hv-cinder-83699 May 09 20:28:49.972644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-7801675d-17cd-433c-ae7f-71403209fc52 req-f0edb23e-2208-42a0-8191-3ac989e0eb63 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029561 May 09 20:28:49.973233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 247/453] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:50.448871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:50.449547 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:50.456281 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:50.456724 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:50.457483 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:50.457908 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:50.486047 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:50.486766 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:50.493658 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:50.494318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:50.495097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:50.495561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:50.634135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:50.643510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:50.645036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:50.646446 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-696b971d-3f9d-45a0-9331-32be638e5e53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1723 microversion: 2.20 time: 0.164582 May 09 20:28:50.647012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 248/454] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:50 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:28:50.769374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:50.776947 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-24b4f926-315c-4f34-b2ab-92180f2a68e0 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.332178 May 09 20:28:50.777527 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 207/455] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:50 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:51.665296 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:51.665907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:51.672539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:51.672986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:51.673743 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:51.674199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:51.793812 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:51.794426 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:51.800649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:51.801101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:51.801863 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:51.802301 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:51.810310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:51.818156 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:51.819702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:51.820854 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e08b3a55-be27-4a7e-a031-84e406d31810 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1723 microversion: 2.20 time: 0.159473 May 09 20:28:51.821408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 249/456] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:51 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:51.936721 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:51.943945 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e7c1f709-82d1-4d6c-8611-0f7b3c9299cb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.154241 May 09 20:28:51.944498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 208/457] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:51 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:52.841286 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:52.841819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:52.848132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:52.848574 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:52.849323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:52.849750 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:52.961201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:52.961817 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:52.975685 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:52.978679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:52.979563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:52.979995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:52.983752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:52.991318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:52.992822 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:52.993961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-816fce4c-5e00-4649-9b61-3da5229eecfe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1723 microversion: 2.20 time: 0.157218 May 09 20:28:52.994517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 250/458] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:52 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:53.105505 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:53.112632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0948e62e-719c-4f72-9ef8-076ef6e19a5a tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.155278 May 09 20:28:53.113180 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 209/459] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:52 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:53.734612 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-fa8fa5da-b648-4bdb-afec-9a495a251f5d req-a00f228d-13ad-4b9f-a0ab-3d180bc71a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425e8732-2c2b-4c37-b2c3-e766712d293f", "name": "network-vif-unplugged", "status": "completed", "tag": "9d1946fe-d370-43ff-a7d4-5a7d9c20d2be"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:53.742412 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-fa8fa5da-b648-4bdb-afec-9a495a251f5d req-a00f228d-13ad-4b9f-a0ab-3d180bc71a92 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:53.742843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-fa8fa5da-b648-4bdb-afec-9a495a251f5d req-a00f228d-13ad-4b9f-a0ab-3d180bc71a92 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:53.754301 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-fa8fa5da-b648-4bdb-afec-9a495a251f5d req-a00f228d-13ad-4b9f-a0ab-3d180bc71a92 service nova] Creating event network-vif-unplugged:9d1946fe-d370-43ff-a7d4-5a7d9c20d2be for instance 425e8732-2c2b-4c37-b2c3-e766712d293f on hv-cinder-83699 May 09 20:28:53.759176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-fa8fa5da-b648-4bdb-afec-9a495a251f5d req-a00f228d-13ad-4b9f-a0ab-3d180bc71a92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028153 May 09 20:28:53.759774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 251/460] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:54.013088 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:54.013708 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:54.019971 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:54.020442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:54.021191 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:54.021614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:54.130659 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:54.131482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:54.138059 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:54.138579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:54.139749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:54.139864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:54.155141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:54.163453 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:54.165033 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:54.166319 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d3d9ba97-9365-4e72-a65e-b3d222f04dd0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1723 microversion: 2.20 time: 0.157672 May 09 20:28:54.171451 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 210/461] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:54 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:54.275682 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:54.283765 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1a6f505e-c48a-4009-aba5-f017d47ea9fd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.157755 May 09 20:28:54.284321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 252/462] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:54 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:55.186434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:55.187036 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:55.193297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:55.193740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:55.194515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:55.194942 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:55.301117 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:55.301756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:55.308636 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:55.309079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:55.309843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:55.310278 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:55.319776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:55.327583 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:55.329103 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:55.330235 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a6b43670-66b3-422b-a28e-9735cfb07b06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1723 microversion: 2.20 time: 0.148397 May 09 20:28:55.330797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 211/463] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:55 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:55.442843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:55.450548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ec585a3d-51b1-42a8-87d8-e60d20e7d3dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.153174 May 09 20:28:55.451121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 253/464] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:55 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:56.349465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:56.350075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:56.356504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.356949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:56.357706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.358138 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:56.467193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:56.467840 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:56.473988 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.474437 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:56.475199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.475659 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:56.485137 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:56.492871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:56.494360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:56.496172 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f5edc1f9-3bbe-444f-b4b1-1e25eec70078 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1666 microversion: 2.20 time: 0.150468 May 09 20:28:56.496733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 212/465] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:56 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:56.514760 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f8698617-1021-441b-84c7-ab1852185fe2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d98d237-8134-49e7-be02-807f11b02214"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:56.516171 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f8698617-1021-441b-84c7-ab1852185fe2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:56.521975 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f8698617-1021-441b-84c7-ab1852185fe2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.522420 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f8698617-1021-441b-84c7-ab1852185fe2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:56.523189 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f8698617-1021-441b-84c7-ab1852185fe2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.523675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f8698617-1021-441b-84c7-ab1852185fe2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:56.606553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:56.613849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0c40db36-8b86-4228-bc14-c916d81e1ffc tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.150709 May 09 20:28:56.614412 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 254/466] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:56 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:28:56.793124 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f8698617-1021-441b-84c7-ab1852185fe2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283180 May 09 20:28:56.793717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 213/467] 10.222.0.44 () {62 vars in 1363 bytes} [Mon May 9 20:28:56 2022] POST /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 20:28:56.903021 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ec0e0863-8383-4dbb-8597-21dc029e0721 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:56.903699 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ec0e0863-8383-4dbb-8597-21dc029e0721 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:56.909596 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec0e0863-8383-4dbb-8597-21dc029e0721 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.910028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec0e0863-8383-4dbb-8597-21dc029e0721 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:56.910983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec0e0863-8383-4dbb-8597-21dc029e0721 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:56.911455 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec0e0863-8383-4dbb-8597-21dc029e0721 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:57.000784 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ec0e0863-8383-4dbb-8597-21dc029e0721 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/action" status: 202 len: 0 microversion: 2.20 time: 0.101695 May 09 20:28:57.001378 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 255/468] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 20:28:56 2022] POST /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 20:28:57.009590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:57.010210 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:57.016965 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:57.017459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:57.018278 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:57.018720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:57.149802 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:57.158801 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:57.160307 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:57.161452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b3e8d131-d6b4-4867-a428-77183be1adfd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1752 microversion: 2.20 time: 0.155787 May 09 20:28:57.162056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 214/469] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:57 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:57.631227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:57.632025 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:57.639095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:57.639581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:57.640357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:57.640795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:57.779102 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:57.786983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6389d584-33d6-4ee1-90bb-d1b1075a5dc5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.159355 May 09 20:28:57.797748 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 256/470] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:57 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:58.179910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:58.180517 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:58.187167 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:58.187637 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:58.188394 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:58.188820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:58.319046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:58.327718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:58.329203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:58.330348 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-bd22bb30-6e96-4442-9115-d6c50cffc007 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1754 microversion: 2.20 time: 0.154406 May 09 20:28:58.330899 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 215/471] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:58 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:58.804419 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:58.804940 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:58.811804 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:58.812251 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:58.813008 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:58.813440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:58.949563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:58.956917 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d54ae83e-0620-4a04-831f-7594a65f6ded tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.156514 May 09 20:28:58.957508 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 257/472] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:58 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:28:59.349724 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:59.350374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:59.357458 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:59.357897 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:59.358649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:59.359072 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:59.553489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:59.561848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:59.563333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:28:59.564503 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9e12331c-9469-4371-a264-bb2dc8aa95ab tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.218657 May 09 20:28:59.565066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 216/473] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:28:59 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:28:59.846377 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-183a9cee-a5c5-4c12-a13b-cf93e4e63081 req-546842b8-9463-4cb2-bde3-10f81a577213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077bf537-9e98-4c10-af59-354395ac91c4", "name": "network-vif-plugged", "status": "completed", "tag": "53c09941-9694-430a-bfb4-0ad45b3d5716"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:28:59.856729 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-183a9cee-a5c5-4c12-a13b-cf93e4e63081 req-546842b8-9463-4cb2-bde3-10f81a577213 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:59.857265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-183a9cee-a5c5-4c12-a13b-cf93e4e63081 req-546842b8-9463-4cb2-bde3-10f81a577213 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:59.868620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-183a9cee-a5c5-4c12-a13b-cf93e4e63081 req-546842b8-9463-4cb2-bde3-10f81a577213 service nova] Creating event network-vif-plugged:53c09941-9694-430a-bfb4-0ad45b3d5716 for instance 077bf537-9e98-4c10-af59-354395ac91c4 on hv-cinder-83699 May 09 20:28:59.874108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-183a9cee-a5c5-4c12-a13b-cf93e4e63081 req-546842b8-9463-4cb2-bde3-10f81a577213 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031484 May 09 20:28:59.874689 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 258/474] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:28:59.973485 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:28:59.974104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:28:59.980625 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:59.981075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:28:59.981845 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:28:59.982284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:00.402228 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:00.412052 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-22ea2814-f413-4654-93ce-0f24e7021491 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.442096 May 09 20:29:00.412632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 217/475] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:28:59 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:00.582616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:00.583317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:00.589589 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:00.590041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:00.590795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:00.591227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:00.727972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:00.737453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:00.738941 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:00.740166 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-403a86d5-a5b0-4470-8a1a-42d668ab2102 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.161873 May 09 20:29:00.740727 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 259/476] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:00 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:01.429215 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:01.429930 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:01.436816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:01.437262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:01.438032 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:01.438469 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:01.568501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:01.575979 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8b658f4b-5598-4526-8317-af0537b1ecc3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.150611 May 09 20:29:01.576743 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 218/477] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:01 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:01.760341 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:01.761021 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:01.774677 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:01.775120 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:01.776536 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:01.776965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:01.905018 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:01.914882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:01.916507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:01.917688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d6e90e26-0d69-4fe4-bceb-0ca4137526d1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.161246 May 09 20:29:01.918230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 260/478] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:01 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:02.593739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:02.594352 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:02.600686 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:02.601134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:02.601898 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:02.602329 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:02.737828 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:02.745501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8957dce7-977d-4bd4-9774-073cf0bcf843 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.155617 May 09 20:29:02.746059 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 219/479] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:02 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:02.936649 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:02.937178 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:02.943623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:02.944073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:02.944837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:02.945267 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:03.075877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:03.084030 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:03.085517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:03.086665 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5b0d388c-1324-4ee7-b2f6-4a6c3997f1cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.153992 May 09 20:29:03.087213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 261/480] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:02 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:03.763246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:03.763887 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:03.770346 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:03.770784 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:03.771580 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:03.772007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:03.903235 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:03.911290 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-06a87c41-0b78-4c41-b9b6-e92015ce6372 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.152551 May 09 20:29:03.911951 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 220/481] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:03 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:04.106487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:04.107052 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:04.114357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:04.114357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:04.114357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:04.114824 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:04.249897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:04.258504 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:04.260594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:04.262737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d1eeb324-a968-47e8-9f9c-43e5c3311bed tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.161437 May 09 20:29:04.263296 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 262/482] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:04 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:04.930821 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:04.931459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:04.937927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:04.938397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:04.939151 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:04.939640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:05.080493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:05.088004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fa1b69e0-728c-416e-b7db-7792a041cd3f tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.162917 May 09 20:29:05.089123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 221/483] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:04 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:05.281728 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:05.282339 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:05.288797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:05.289323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:05.290168 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:05.290713 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:05.424060 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:05.432521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:05.434015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:05.435188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6ae1ee4f-668d-4789-bf03-d7d801625f1f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.157349 May 09 20:29:05.435770 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 263/484] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:05 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:06.105713 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:06.106332 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:06.112626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:06.113063 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:06.113813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:06.114230 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:06.260344 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:06.268074 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5bd222f2-2a62-4894-bc21-469833aab8a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.166811 May 09 20:29:06.268639 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 222/485] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:06 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:06.453794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:06.455171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:06.461773 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:06.462244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:06.462996 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:06.464281 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:06.602633 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:06.614378 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:06.617342 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:06.618647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-aa9bd823-7c54-4c7e-80e4-8f31ea16d2cb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.168888 May 09 20:29:06.619309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 264/486] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:06 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:07.284957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:07.285523 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:07.291927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:07.292363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:07.293125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:07.293551 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:07.423942 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:07.431337 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8e33bc34-24e6-4d80-9359-6368610bc89d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.150325 May 09 20:29:07.431944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 223/487] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:07 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:07.638747 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:07.639506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:07.645889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:07.646333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:07.647105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:07.647600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:07.782827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:07.791523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:07.793303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:07.794511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8e3e1bbd-5679-4950-906a-b968cc737024 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.160585 May 09 20:29:07.795062 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 265/488] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:07 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:08.447283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:08.447918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:08.454171 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:08.454612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:08.455368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:08.455822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:08.594530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:08.601693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c875177d-8246-4a53-9343-0b90e0dfb4dd tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.158253 May 09 20:29:08.602254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 224/489] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:08 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:08.813352 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:08.814125 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:08.820481 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:08.820931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:08.821688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:08.822116 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:08.965970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:08.974501 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:08.976114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:08.978026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-68488ca3-cd8c-47c2-b9e4-33fba0a0fcda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.168641 May 09 20:29:08.978906 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 266/490] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:08 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:09.620335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:09.621139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:09.627751 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:09.628192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:09.628950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:09.629378 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:09.760433 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:09.768448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-634cce0b-f4eb-4449-bd4a-b15510006deb tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.152555 May 09 20:29:09.769019 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 225/491] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:09 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:09.997372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:09.997984 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:10.004256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:10.004694 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:10.005447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:10.005882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:10.144552 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:10.155166 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:10.156727 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:10.158182 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8722290d-9aa8-415a-8070-1608e957ab08 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.164652 May 09 20:29:10.158869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 267/492] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:09 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:29:10.785727 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:10.786363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:10.793643 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:10.794177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:10.794945 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:10.795379 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:10.930629 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:10.938813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ea690dab-186c-44cb-83f0-e53b1cea85be tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.156968 May 09 20:29:10.939361 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 226/493] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:10 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:11.177482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:11.178224 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:11.185078 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:11.185522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:11.186302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:11.186734 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:11.321152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:11.329920 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:11.331450 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:11.332563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-713a0d4d-5c71-4bd1-9b9e-96c935edafb0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.159103 May 09 20:29:11.333120 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 268/494] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:11 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:11.955804 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:11.956500 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:11.962926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:11.964023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:11.964884 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:11.965309 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:12.104129 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:12.111522 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fee5acdb-788e-46a9-b9ad-25dba696ac9d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.159688 May 09 20:29:12.112283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 227/495] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:11 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:12.351048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:12.351685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:12.358773 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:12.359229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:12.360031 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:12.360467 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:12.494601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:12.503109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:12.504694 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:12.505847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a3a62d8a-623e-45b9-950f-84836dd8d375 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.158655 May 09 20:29:12.506408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 269/496] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:12 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:13.129278 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:13.129891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:13.136900 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:13.137338 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:13.138104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:13.138531 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:13.271004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:13.278571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9c46e94c-a476-4f3c-a4c8-e485961b62e5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.153136 May 09 20:29:13.279343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 228/497] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:13 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:13.525445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:13.526364 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:13.533306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:13.533761 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:13.534525 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:13.534951 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:13.670777 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:13.679327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:13.680841 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:13.681989 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4a744c2a-c740-4d1c-bc1e-b47a7be4d98c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.160520 May 09 20:29:13.682542 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 270/498] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:13 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:14.296277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:14.296892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:14.303270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:14.303737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:14.304505 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:14.304934 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:14.439961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:14.447493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e3d49f99-81d5-4090-8cd1-a9dfc1bb230c tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.155638 May 09 20:29:14.448062 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 229/499] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:14 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:14.702056 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:14.705064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:14.716675 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:14.717270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:14.718051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:14.718486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:14.851798 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:14.860335 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:14.863645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:14.863645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ab0e0123-857c-4681-8ea1-dc75aafc556e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.165608 May 09 20:29:14.863645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 271/500] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:14 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:15.465080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:15.465688 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:15.471995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:15.472466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:15.473220 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:15.473653 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:15.599015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:15.606773 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fcd5ecf8-e857-4f57-9065-08c83b95599d tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.145510 May 09 20:29:15.607333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 230/501] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:15 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:15.881273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:15.881845 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:15.888547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:15.888984 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:15.889731 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:15.890159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:16.018012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:16.026089 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:16.028367 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:16.029517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8aa53a44-f95f-44fa-8c3b-841f6891b945 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.152152 May 09 20:29:16.030062 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 272/502] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:15 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:16.623111 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:16.623753 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:16.630103 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:16.630547 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:16.631337 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:16.631793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:16.760141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:16.767718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c87e40f8-f077-414a-97e6-b30aa21e2f0e tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.148360 May 09 20:29:16.771747 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 231/503] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:16 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:17.048179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:17.048790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:17.055034 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:17.055602 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:17.056388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:17.056823 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:17.183109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:17.191768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:17.193273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:17.194429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f0c3c730-0fce-44ad-80ab-37ccbcab8b9a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.150124 May 09 20:29:17.194988 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 273/504] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:17 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:17.784305 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:17.784911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:17.791122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:17.791587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:17.792905 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:17.793372 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:17.920425 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:17.927829 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-260d30a0-b8fa-4cb7-952c-8dfeebd866e1 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.147378 May 09 20:29:17.928698 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 232/505] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:17 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:18.213794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:18.215040 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:18.221406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:18.221847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:18.222593 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:18.223023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:18.352771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:18.360892 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:18.362393 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:18.363555 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-429797cb-643a-453d-98af-9cb1c0b042a1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.153720 May 09 20:29:18.364105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 274/506] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:18 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:18.944759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:18.945315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:18.952132 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:18.952896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:18.953654 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:18.954072 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:19.081626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:19.088676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-aae155fb-191c-4da8-809c-9a6cee071ef3 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.147980 May 09 20:29:19.089278 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 233/507] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:18 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:19.381958 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:19.382577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:19.389113 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:19.389553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:19.390300 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:19.390727 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:19.515651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:19.523871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:19.525358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:19.526502 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3b128607-7857-4744-be48-69967daed5b1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.148448 May 09 20:29:19.527059 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 275/508] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:19 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:20.105502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:20.106102 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:20.112436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:20.112875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:20.113617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:20.114038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:20.239332 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:20.247113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-96d2f3b4-8f9d-4b59-8f4c-eb5854b27f71 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1319 microversion: 2.1 time: 0.145517 May 09 20:29:20.247699 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 234/509] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:20 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:20.545808 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:20.546425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:20.553036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:20.553488 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:20.554252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:20.554691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:20.688346 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:20.696469 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:20.697939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:20.699115 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-72c0d1af-4a86-4f9e-8f29-cf197e8ab137 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.157854 May 09 20:29:20.699717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 276/510] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:20 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:21.264599 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:21.265214 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:21.271533 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:21.271986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:21.272742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:21.273177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:21.403823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:21.410997 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ba5edc96-5be4-46d1-9f1b-c354ef7f67a5 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1508 microversion: 2.1 time: 0.151208 May 09 20:29:21.411584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 235/511] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:21 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:21.426995 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e7da2ef7-e05d-4654-8449-c73d9226f0ef tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9a37d76-c4da-412b-bf3c-47a3a1c7ba93", "device": "/dev/sdb"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:29:21.428644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e7da2ef7-e05d-4654-8449-c73d9226f0ef tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:21.434359 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e7da2ef7-e05d-4654-8449-c73d9226f0ef tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:21.434803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e7da2ef7-e05d-4654-8449-c73d9226f0ef tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:21.435587 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e7da2ef7-e05d-4654-8449-c73d9226f0ef tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:21.436017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e7da2ef7-e05d-4654-8449-c73d9226f0ef tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:21.660702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e7da2ef7-e05d-4654-8449-c73d9226f0ef tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "POST /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.237385 May 09 20:29:21.662116 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 277/512] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:29:21 2022] POST /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4/os-volume_attachments => generated 194 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:29:21.723118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:21.723761 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:21.729669 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:21.730440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:21.731206 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:21.731657 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:21.865854 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:21.874697 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:21.876217 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:21.877365 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d68599bf-69ed-4630-89ac-0fdf77d664f6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.164796 May 09 20:29:21.877924 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 236/513] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:21 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:29:22.896777 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:22.897395 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:22.904426 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:22.904876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:22.905647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:22.906084 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:23.033307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:23.041551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:23.043350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:23.044529 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3853d623-b768-4c47-a046-8e8ba4eead97 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.152818 May 09 20:29:23.045090 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 278/514] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:22 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:24.062871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:24.063498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:24.069846 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:24.070283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:24.071058 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:24.071509 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:24.199726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:24.208298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:24.209798 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:24.210950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a223149e-4a77-473e-aeaa-6bd064a6259a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.151940 May 09 20:29:24.211531 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 237/515] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:24 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:25.230898 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:25.231792 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:25.239499 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:25.239950 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:25.240710 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:25.241144 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:25.372414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:25.380907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:25.382390 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:25.383584 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ccd3c44d-1ccf-42c8-9e4a-c29268aec703 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.157334 May 09 20:29:25.384141 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 279/516] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:25 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:26.404201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:26.404805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:26.411075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:26.411554 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:26.412314 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:26.412747 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:26.546266 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:26.554286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:26.555833 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:26.556969 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-bb622a7f-aa2e-485c-be19-a8f47b32884d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.158362 May 09 20:29:26.557520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 238/517] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:26 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:27.576233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:27.576899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:27.583364 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:27.583830 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:27.584639 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:27.585109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:27.722279 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:27.731848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:27.733318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:27.734454 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a6d739da-d48b-4cf7-8af6-6641f0bc8d04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.162356 May 09 20:29:27.735011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 280/518] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:27 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:28.753546 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:28.754157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:28.761982 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:28.762427 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:28.763194 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:28.763680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:29.066179 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:29.076297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:29.078150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:29.079506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e20e3b3a-168c-49c0-9521-165c1d144c01 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.330261 May 09 20:29:29.080821 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 239/519] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:28 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:30.099661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:30.100277 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:30.110396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:30.110835 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:30.111637 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:30.112066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:30.304147 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:30.313090 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:30.314571 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:30.315759 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-bfb4c110-8a63-4332-b2be-445d9c621618 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.220120 May 09 20:29:30.316327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 281/520] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:30 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:31.333823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:31.334428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:31.340929 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:31.341368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:31.342115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:31.342541 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:31.491509 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:31.502592 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:31.504119 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:31.505270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9a135d76-6b16-4f05-974c-bbabef505b82 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.175288 May 09 20:29:31.505824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 240/521] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:31 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:31.709398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-be169366-5e92-406a-bdc8-3077d9283be5 req-4ea1e6c2-c546-45fb-8939-160cd1dc6f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425e8732-2c2b-4c37-b2c3-e766712d293f", "name": "network-vif-plugged", "status": "completed", "tag": "9d1946fe-d370-43ff-a7d4-5a7d9c20d2be"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:29:31.719105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-be169366-5e92-406a-bdc8-3077d9283be5 req-4ea1e6c2-c546-45fb-8939-160cd1dc6f74 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:31.719795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-be169366-5e92-406a-bdc8-3077d9283be5 req-4ea1e6c2-c546-45fb-8939-160cd1dc6f74 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:31.735425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-be169366-5e92-406a-bdc8-3077d9283be5 req-4ea1e6c2-c546-45fb-8939-160cd1dc6f74 service nova] Creating event network-vif-plugged:9d1946fe-d370-43ff-a7d4-5a7d9c20d2be for instance 425e8732-2c2b-4c37-b2c3-e766712d293f on hv-cinder-83699 May 09 20:29:31.740280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-be169366-5e92-406a-bdc8-3077d9283be5 req-4ea1e6c2-c546-45fb-8939-160cd1dc6f74 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034509 May 09 20:29:31.740859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 282/522] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:29:32.524904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:32.525492 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:32.532368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:32.532805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:32.533550 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:32.533977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:32.663115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:32.671449 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:32.672978 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:32.674131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3bdfc0ed-b3e0-46a7-a101-bf3bd4444cef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.153123 May 09 20:29:32.674685 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 241/523] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:32 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:33.693635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:33.694303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:33.700726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:33.701171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:33.701929 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:33.702361 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:33.833236 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:33.841981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:33.843485 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:33.844639 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-737c08b2-513d-416d-a18f-6c958a7d2160 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.155802 May 09 20:29:33.845191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 283/524] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:33 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:34.862392 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:34.862998 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:34.869391 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:34.869836 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:34.871295 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:34.871750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:35.007630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:35.017501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:35.018983 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:35.020158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-91563c42-bd8f-4593-b356-890889a183c3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.161732 May 09 20:29:35.020717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 242/525] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:34 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:36.038043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:36.038679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:36.044963 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:36.045408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:36.046170 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:36.046601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:36.171966 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:36.180012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:36.181485 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:36.183268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-14ae54f4-d453-4573-a7f8-f1a5d815db06 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.148543 May 09 20:29:36.183854 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 284/526] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:36 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:37.202224 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:37.202888 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:37.209081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:37.209516 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:37.210257 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:37.210684 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:37.337711 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:37.346167 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:37.347666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:37.348805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3cbc4802-69ce-43f4-ab73-6a34811687b8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.151087 May 09 20:29:37.349372 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 243/527] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:37 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:38.367883 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:38.368470 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:38.374846 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:38.375290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:38.376075 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:38.376507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:38.503845 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:38.512663 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:38.514141 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:38.515292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-cbc3f0c8-a8b6-476d-a08c-13ef8bbe85a8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.151283 May 09 20:29:38.515882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 285/528] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:38 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:39.533614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:39.534223 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:39.540575 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:39.541019 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:39.541857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:39.542841 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:39.674395 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:39.682561 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:39.684062 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:39.685222 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4875d5e5-1821-452b-b479-e814d143d775 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.155515 May 09 20:29:39.685781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 244/529] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:39 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:40.703699 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:40.704309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:40.710589 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:40.711444 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:40.712424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:40.712869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:40.839343 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:40.847479 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:40.849000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:40.850148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1dd7c81d-d346-4144-b022-94484b3530cc tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.150382 May 09 20:29:40.850708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 286/530] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:40 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:41.869011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:41.869644 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:41.876529 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:41.876967 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:41.877714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:41.878142 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:42.014592 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:42.023276 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:42.024797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:42.025977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1fc4ff15-f06c-4680-b0df-db872a511e0e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.160835 May 09 20:29:42.026674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 245/531] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:41 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:42.180101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1f28fda7-7582-4f02-af8f-34665567e74b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3415bcbf-2039-4638-be74-b947e42ded35"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:29:42.181216 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1f28fda7-7582-4f02-af8f-34665567e74b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:42.187676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f28fda7-7582-4f02-af8f-34665567e74b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:42.188120 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f28fda7-7582-4f02-af8f-34665567e74b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:42.188866 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f28fda7-7582-4f02-af8f-34665567e74b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:42.189295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f28fda7-7582-4f02-af8f-34665567e74b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:42.457334 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1f28fda7-7582-4f02-af8f-34665567e74b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377773 May 09 20:29:42.457921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 287/532] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:29:42 2022] POST /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:29:43.045454 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:43.046287 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:43.052815 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:43.053446 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:43.054236 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:43.054660 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:43.209511 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:43.218561 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:43.220125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:43.221262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f894fd44-9e65-472a-806b-6d1fe206e29b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1810 microversion: 2.20 time: 0.180727 May 09 20:29:43.221987 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 246/533] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:43 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:44.243080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:44.243803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:44.250492 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:44.250938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:44.251735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:44.252196 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:44.381480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:44.389980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:44.391487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:44.392639 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-80d99950-6698-4e4d-a096-1073040626aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1797 microversion: 2.20 time: 0.154270 May 09 20:29:44.393194 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 288/534] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:29:44 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1797 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:29:45.076813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:45.077291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:45.083524 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:45.083962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:45.084708 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:45.085166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:45.173667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lazy-loading 'services' on Instance uuid 077bf537-9e98-4c10-af59-354395ac91c4 {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:29:45.258160 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cd97c061-52f4-4136-825e-f6cf044fc992 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "DELETE /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4/os-volume_attachments/c9a37d76-c4da-412b-bf3c-47a3a1c7ba93" status: 202 len: 0 microversion: 2.1 time: 0.185591 May 09 20:29:45.258781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 247/535] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:29:45 2022] DELETE /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4/os-volume_attachments/c9a37d76-c4da-412b-bf3c-47a3a1c7ba93 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:29:45.289202 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:29:45.289439 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:29:50.983703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:29:50.984693 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:50.991012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:50.991526 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:50.992288 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:50.992714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:51.017244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lazy-loading 'flavor' on Instance uuid 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:29:51.135730 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-096e0a58-af68-49ee-b787-a3938c44a50f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/action" status: 200 len: 32 microversion: 2.1 time: 0.156573 May 09 20:29:51.137055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 289/536] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:29:50 2022] POST /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:29:51.147240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:51.147967 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:51.155346 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:51.156064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:51.156833 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:51.157262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:51.356841 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:51.364716 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-613cac39-e410-45b7-9999-6833d57f7a7d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.221740 May 09 20:29:51.365373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 248/537] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:51 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:51.642302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:51.643258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:51.649592 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:51.650415 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:51.650762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:51.651197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:51.680245 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:29:51.769617 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-68702cb5-1fd9-47f9-ae26-22774a8eaf47 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "DELETE /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 204 len: 0 microversion: 2.1 time: 0.132020 May 09 20:29:51.770371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 290/538] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:29:51 2022] DELETE /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:29:51.779442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:51.780050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:51.786289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:51.786738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:51.787862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:51.788750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:51.922793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:51.930784 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0fdf3c2c-0e10-43ea-91f6-991bceb4ef81 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1514 microversion: 2.1 time: 0.156144 May 09 20:29:51.931379 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 249/539] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:51 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:29:52.382601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:52.383304 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:52.390290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:52.390735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:52.391512 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:52.391947 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:52.521365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:52.529228 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2d9fbd64-d8cf-42b9-a3a1-8900eb267e09 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.150889 May 09 20:29:52.529783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 291/540] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:52 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:52.947802 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:52.948411 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:52.954917 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:52.955359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:52.956139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:52.956565 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:53.086041 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:53.094002 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b4d2878a-82c2-463a-a555-e2ae06637879 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1514 microversion: 2.1 time: 0.149978 May 09 20:29:53.094560 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 250/541] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:52 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:29:53.546600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:53.547204 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:53.554474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:53.554913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:53.555690 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:53.556121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:53.684070 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:53.691787 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0c1d5c02-842b-4d7d-a0af-f67a1d7cd25f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.149210 May 09 20:29:53.692347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 292/542] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:53 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:54.111243 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:54.111954 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:54.118299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:54.118658 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:54.119418 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:54.119850 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:54.222440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e50a700ac8f4e708b23e35ffa57e4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970fffc753884be893292412dc3a6f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:54.229848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-90210f7e-ec1c-465b-90d8-1a9144100505 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 200 len: 1472 microversion: 2.1 time: 0.122530 May 09 20:29:54.230950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 251/543] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:54 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 1472 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:54.269109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-b103e9cb-d93c-4933-bfb6-ee2628fe0e9a req-52ca968e-1f3e-43d3-83ae-9cc69c48f4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077bf537-9e98-4c10-af59-354395ac91c4", "name": "network-vif-deleted", "tag": "53c09941-9694-430a-bfb4-0ad45b3d5716"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:29:54.276911 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b103e9cb-d93c-4933-bfb6-ee2628fe0e9a req-52ca968e-1f3e-43d3-83ae-9cc69c48f4f5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:54.277371 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b103e9cb-d93c-4933-bfb6-ee2628fe0e9a req-52ca968e-1f3e-43d3-83ae-9cc69c48f4f5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:54.288857 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-b103e9cb-d93c-4933-bfb6-ee2628fe0e9a req-52ca968e-1f3e-43d3-83ae-9cc69c48f4f5 service nova] Creating event network-vif-deleted:53c09941-9694-430a-bfb4-0ad45b3d5716 for instance 077bf537-9e98-4c10-af59-354395ac91c4 on hv-cinder-83699 May 09 20:29:54.294255 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-b103e9cb-d93c-4933-bfb6-ee2628fe0e9a req-52ca968e-1f3e-43d3-83ae-9cc69c48f4f5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091291 May 09 20:29:54.295066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 293/544] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:29:54.709961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:54.710620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:54.716990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:54.717438 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:54.718198 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:54.718630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:54.851150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:54.860035 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3f028011-7c4e-4818-bda1-1d8e65aee4d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.154242 May 09 20:29:54.860587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 252/545] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:54 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:55.249163 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:55.249859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] [instance: 077bf537-9e98-4c10-af59-354395ac91c4] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:55.255926 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:55.256365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:55.257111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:55.257541 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:55.270968 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] HTTP exception thrown: Instance 077bf537-9e98-4c10-af59-354395ac91c4 could not be found. May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Request method failure captured: May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 HTTP/1.1 May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXkfysEutSbGwH-OdK2WleRYLaGx8sLPwb7y7kADuW74kBdLdMSsj-Q-gtbVv6ZUiA7LDz-wYK2Kv0QvodYKIAHYhyP62k3LIJ7OHC3BYm-1qZz4TAzJ3HBEcNfsnZ2O8_8f4v0_fsiXo1J3M5VZOZ-5aHLn_VF9EYN2dLIr7QfsbSo May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 970fffc753884be893292412dc3a6f69 May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-VolumesSnapshotTestJSON-432389011 May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:29:55.272563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/970fffc753884be893292412dc3a6f69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_970fffc753884be893292412dc3a6f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/970fffc753884be893292412dc3a6f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/970fffc753884be893292412dc3a6f69"}]}] May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-VolumesSnapshotTestJSON-432389011 May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 970fffc753884be893292412dc3a6f69 May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-432389011 May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-VolumesSnapshotTestJSON-432389011-project May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 3e50a700ac8f4e708b23e35ffa57e4cf May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-VolumesSnapshotTestJSON-432389011-project May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 077bf537-9e98-4c10-af59-354395ac91c4 could not be found. May 09 20:29:55.274050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '077bf537-9e98-4c10-af59-354395ac91c4'} May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077bf537-9e98-4c10-af59-354395ac91c4 could not be found. May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:29:55.274819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077bf537-9e98-4c10-af59-354395ac91c4 could not be found. May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077bf537-9e98-4c10-af59-354395ac91c4 could not be found. May 09 20:29:55.276162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:29:55.277961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] Returning 404 to user: Instance 077bf537-9e98-4c10-af59-354395ac91c4 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:29:55.277961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-69aa4741-6543-43a9-ba38-357f09b4da39 tempest-VolumesSnapshotTestJSON-432389011 tempest-VolumesSnapshotTestJSON-432389011-project] 10.222.0.44 "GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4" status: 404 len: 111 microversion: 2.1 time: 0.029418 May 09 20:29:55.277961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 294/546] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:55 2022] GET /compute/v2.1/servers/077bf537-9e98-4c10-af59-354395ac91c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:29:55.877693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:55.878238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:55.884476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:55.884912 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:55.885658 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:55.886995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:56.013091 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:56.020865 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c6e85cba-c856-4acf-b752-a3a750aaf44a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.147093 May 09 20:29:56.021426 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 253/547] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:55 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:57.038522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:57.039162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:57.045466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:57.045904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:57.046655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:57.047079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:57.177264 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:57.185436 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e4450f9c-4e6e-4561-a344-60511faca8ee tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.150773 May 09 20:29:57.185980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 295/548] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:57 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:58.203236 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:58.203880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:58.210189 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:58.210632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:58.211429 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:58.211891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:58.336462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:58.344883 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6ef35bfb-9a59-4482-81a3-e25e5467d4f2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.146202 May 09 20:29:58.345441 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 254/549] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:58 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:29:59.361694 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:29:59.362337 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:29:59.368658 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:59.369101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:59.369855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:29:59.370287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:29:59.496564 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:29:59.504223 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1c6ed227-fd8a-4a12-a200-11920747b7cd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.146329 May 09 20:29:59.504774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 296/550] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:29:59 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:00.521484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:00.522087 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:00.528532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:00.528973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:00.529724 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:00.530148 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:00.658370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:00.666006 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5c2ad055-4854-4055-b8be-92bf93abd079 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.148374 May 09 20:30:00.666548 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 255/551] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:00 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:01.684284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:01.684896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:01.691167 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:01.691648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:01.692413 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:01.692844 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:01.818940 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:01.827293 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e6edf874-f1e9-4eb1-8e20-7e6d95c7e47a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.147404 May 09 20:30:01.827876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 297/552] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:01 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:02.845333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:02.845891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:02.854738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:02.855268 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:02.856224 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:02.856718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:02.984984 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:02.992662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b747f341-b07d-4849-ae65-52457a5d2130 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.151300 May 09 20:30:02.993218 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 256/553] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:02 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:04.009813 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:04.010449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:04.017008 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:04.017446 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:04.018196 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:04.018624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:04.146203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:04.154429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ae30af2f-a19d-40da-a73f-3df7ba03da50 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.148420 May 09 20:30:04.154976 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 298/554] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:04 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:05.172309 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:05.172919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:05.179248 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:05.179727 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:05.180485 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:05.180918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:05.309810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:05.318586 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a168a328-777b-4657-b450-926f2d0e1254 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.150796 May 09 20:30:05.319151 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 257/555] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:05 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:06.336030 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:06.336647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:06.342993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:06.343465 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:06.344228 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:06.344664 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:06.471590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:06.479261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8ce14b8f-33b9-4164-88b4-6ebb01d45082 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.147099 May 09 20:30:06.479847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 299/556] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:06 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:07.496408 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:07.497151 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:07.503566 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:07.504012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:07.504770 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:07.505197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:07.636290 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:07.644601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-868519af-df9e-46e1-9ee1-47cde01b870b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.151994 May 09 20:30:07.645161 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 258/557] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:07 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:30:08.667597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:08.668211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:08.675159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:08.675701 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:08.676470 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:08.676898 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:09.018098 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:09.025772 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0f82bc1c-b187-4688-a857-27849af7477f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.362085 May 09 20:30:09.026323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 300/558] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:08 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:10.043709 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:10.044949 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:10.051230 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:10.051704 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:10.052466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:10.052903 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:10.179611 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:10.187536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-82b2ad94-1ed8-46f2-8902-0a2f82799e3a tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.147625 May 09 20:30:10.188094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 259/559] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:10 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:11.205656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:11.206118 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:11.212918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:11.213510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:11.214295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:11.214719 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:11.349667 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:11.357385 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d5750b80-e376-4534-812c-26127525e7c6 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.156000 May 09 20:30:11.357939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 301/560] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:11 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:12.373787 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:12.374421 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:12.380686 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:12.381140 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:12.381896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:12.382359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:12.513320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:12.521159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6f2d4a51-2f7e-4fc2-8204-84c12de0de83 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.151200 May 09 20:30:12.521660 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 260/561] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:12 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:13.537946 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:13.538558 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:13.545535 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:13.546019 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:13.547192 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:13.547708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:13.679015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:13.686857 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-db12f794-cc53-44de-9fe4-bcb037780749 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.152828 May 09 20:30:13.687441 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 302/562] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:13 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:14.704174 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:14.704782 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:14.711007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:14.711496 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:14.712242 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:14.712666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:14.840363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:14.848917 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5bdc749e-f428-4428-b4f3-212b60b5e980 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.148532 May 09 20:30:14.849471 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 261/563] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:14 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:15.867237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:15.867813 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:15.875035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:15.875516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:15.876285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:15.876720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:16.006657 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:16.015263 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-480d5019-4363-4b13-8c00-fe8d38e7a37e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.152072 May 09 20:30:16.015848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 303/564] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:15 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:17.031998 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:17.032605 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:17.038978 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:17.039430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:17.040187 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:17.040662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:17.178216 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:17.186074 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-54ab7673-ba63-463a-b86f-5dd1c19896b3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1734 microversion: 2.1 time: 0.158539 May 09 20:30:17.186623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 262/565] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:17 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:18.203028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:18.203676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:18.210648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.211452 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.212782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.213529 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.341216 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:18.348918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-67f9b7d6-3312-4fc2-bb97-7b42ca050046 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1714 microversion: 2.1 time: 0.149760 May 09 20:30:18.349486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 304/566] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:18 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:18.404678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:18.405221 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:18.411622 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.412063 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.412811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.413234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.490857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] HTTP exception thrown: Cannot 'detach_volume' instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 while it is in vm_state rescued May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Request method failure captured: May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: DELETE /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments/3415bcbf-2039-4638-be74-b947e42ded35 HTTP/1.1 May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiFsWQLIuO_MFnR6wXlqONSU-j1NHvohap0NnRPLJqroveZcYxwK4WYSQQ0nEZPDNIIOOvTvyXTOfii11W38YqbShW2XvMbKpI_IXPpfVP3e1dODEezPuqZyfDVKRs5HqTmMvCkOl-kqpmTiORx0H76ve0b1M7AbcA-BXbp9FC3xMY May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:30:18.492452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96a116cd334648f185dbf35bfa3ade00"}]}] May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 797d7c0dfda747549456236e9e639466 May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:30:18.493991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Cannot 'detach_volume' instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 while it is in vm_state rescued May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'server_id': '51484383-fe65-4cb3-9ed3-d42efa4bc5f9', 'id': '3415bcbf-2039-4638-be74-b947e42ded35'} May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:30:18.494811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 while it is in vm_state rescued May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 while it is in vm_state rescued May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:18.496286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Returning 409 to user: Cannot 'detach_volume' instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 while it is in vm_state rescued {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:30:18.497562 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-06549236-edbb-4dfb-9256-ac51cedf9ba2 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments/3415bcbf-2039-4638-be74-b947e42ded35" status: 409 len: 152 microversion: 2.1 time: 0.093793 May 09 20:30:18.497562 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 263/567] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:30:18 2022] DELETE /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments/3415bcbf-2039-4638-be74-b947e42ded35 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 20:30:18.503224 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c687f71f-8ae1-4736-9d5b-a4e91dd20034 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:18.503816 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c687f71f-8ae1-4736-9d5b-a4e91dd20034 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:18.509632 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c687f71f-8ae1-4736-9d5b-a4e91dd20034 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.510076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c687f71f-8ae1-4736-9d5b-a4e91dd20034 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.510847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c687f71f-8ae1-4736-9d5b-a4e91dd20034 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.511550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c687f71f-8ae1-4736-9d5b-a4e91dd20034 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.577770 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c687f71f-8ae1-4736-9d5b-a4e91dd20034 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "POST /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/action" status: 202 len: 0 microversion: 2.1 time: 0.078117 May 09 20:30:18.579557 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 305/568] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:30:18 2022] POST /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:30:18.587192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:18.587945 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:18.594543 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.595077 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.595768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:18.596198 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:18.807896 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:18.816536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1e41a1a4-cad1-46b8-b126-4b2c9b670b72 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1722 microversion: 2.1 time: 0.233735 May 09 20:30:18.817092 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 264/569] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:18 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:19.834559 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:19.835172 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:19.842646 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:19.843087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:19.843865 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:19.844295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:19.974895 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:19.982702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f420184e-3b89-4136-a25b-7f65eb825436 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1722 microversion: 2.1 time: 0.152365 May 09 20:30:19.983249 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 306/570] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:19 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:21.000406 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:21.001025 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:21.007000 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:21.007484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:21.008253 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:21.008684 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:21.180299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:21.189285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6a4043c7-6646-4510-a092-ab30b83c411d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1722 microversion: 2.1 time: 0.193031 May 09 20:30:21.199015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 265/571] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:20 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:22.206048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:22.206656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:22.212917 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:22.213358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:22.214108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:22.214538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:22.347639 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:22.355431 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3a48883a-3520-4e6c-a67a-06e5cb08d5c0 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1728 microversion: 2.1 time: 0.153220 May 09 20:30:22.356474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 307/572] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:22 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:22.372985 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4f87d4e0-f01a-41d8-a0e3-f1645e1b2678 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:22.373498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4f87d4e0-f01a-41d8-a0e3-f1645e1b2678 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:22.379767 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f87d4e0-f01a-41d8-a0e3-f1645e1b2678 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:22.380215 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f87d4e0-f01a-41d8-a0e3-f1645e1b2678 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:22.380975 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f87d4e0-f01a-41d8-a0e3-f1645e1b2678 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:22.381409 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f87d4e0-f01a-41d8-a0e3-f1645e1b2678 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:22.456875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4f87d4e0-f01a-41d8-a0e3-f1645e1b2678 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088451 May 09 20:30:22.457398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 266/573] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:30:22 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:23.607992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-d8523a53-89dd-4edd-a0fa-c7214f7ac261 req-f72b63a2-6984-4a81-82ec-87d2ff294777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51484383-fe65-4cb3-9ed3-d42efa4bc5f9", "tag": "e33030b9-6c9e-4361-9911-d23fdfcce223"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:23.616318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-d8523a53-89dd-4edd-a0fa-c7214f7ac261 req-f72b63a2-6984-4a81-82ec-87d2ff294777 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:23.616767 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-d8523a53-89dd-4edd-a0fa-c7214f7ac261 req-f72b63a2-6984-4a81-82ec-87d2ff294777 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:23.627850 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-d8523a53-89dd-4edd-a0fa-c7214f7ac261 req-f72b63a2-6984-4a81-82ec-87d2ff294777 service nova] Creating event network-changed:e33030b9-6c9e-4361-9911-d23fdfcce223 for instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 on hv-cinder-83699 May 09 20:30:23.633531 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-d8523a53-89dd-4edd-a0fa-c7214f7ac261 req-f72b63a2-6984-4a81-82ec-87d2ff294777 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029956 May 09 20:30:23.634304 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 308/574] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:30:25.648011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-100d857e-995d-4f8f-982f-a3a1c990f16c req-212faaca-51cd-4ba0-967d-79a0b1977016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51484383-fe65-4cb3-9ed3-d42efa4bc5f9", "tag": "e33030b9-6c9e-4361-9911-d23fdfcce223"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:25.656899 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-100d857e-995d-4f8f-982f-a3a1c990f16c req-212faaca-51cd-4ba0-967d-79a0b1977016 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:25.657336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-100d857e-995d-4f8f-982f-a3a1c990f16c req-212faaca-51cd-4ba0-967d-79a0b1977016 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:25.668118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-100d857e-995d-4f8f-982f-a3a1c990f16c req-212faaca-51cd-4ba0-967d-79a0b1977016 service nova] Creating event network-changed:e33030b9-6c9e-4361-9911-d23fdfcce223 for instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 on hv-cinder-83699 May 09 20:30:25.673631 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-100d857e-995d-4f8f-982f-a3a1c990f16c req-212faaca-51cd-4ba0-967d-79a0b1977016 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029948 May 09 20:30:25.674192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 267/575] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:26.047068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:26.047887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:26.053978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:26.054517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:26.055351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:26.055879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:26.183579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lazy-loading 'services' on Instance uuid 5e5859d0-753a-4eb6-9c16-6a21b2a0758b {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:30:26.302048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2533462a-305d-4d2f-af34-45c92bc055ac tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-volume_attachments/5df445f7-2270-4bec-b4f2-70355f1d5812" status: 202 len: 0 microversion: 2.1 time: 0.481897 May 09 20:30:26.302650 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 309/576] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:30:25 2022] DELETE /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-volume_attachments/5df445f7-2270-4bec-b4f2-70355f1d5812 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:30:27.416986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4739eb50-f8cc-4732-8fa3-f2be88a547f7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:27.423729 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4739eb50-f8cc-4732-8fa3-f2be88a547f7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:27.424177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4739eb50-f8cc-4732-8fa3-f2be88a547f7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:27.482839 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4739eb50-f8cc-4732-8fa3-f2be88a547f7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Going to try to stop instance {{(pid=116850) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 20:30:27.524157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4739eb50-f8cc-4732-8fa3-f2be88a547f7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action" status: 202 len: 0 microversion: 2.1 time: 0.111633 May 09 20:30:27.524742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 268/577] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:30:27 2022] POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:30:27.534897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:27.535670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:27.542354 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:27.542812 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:27.543696 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:27.544191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:27.680535 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:27.687914 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5dcbd5d0-cc29-47dd-a445-4b0e4413de78 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.157826 May 09 20:30:27.688469 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 310/578] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:27 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:28.706956 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:28.707679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:28.713731 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:28.714174 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:28.714931 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:28.715638 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:28.843246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:28.850608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-30672b17-f8f1-4a49-8e19-9cc3f6506dcf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.148418 May 09 20:30:28.851232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 269/579] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:28 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:29.867938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:29.868473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:29.879907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:29.880399 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:29.881246 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:29.881701 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:30.015916 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:30.023114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-407b578a-dc9d-423b-abd4-3a9ba95b7c9f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.159133 May 09 20:30:30.023704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 311/580] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:29 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:31.040728 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:31.041331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:31.047705 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:31.048143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:31.048887 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:31.049312 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:31.181904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:31.190410 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e1b1de70-8d77-402f-9c51-b2f0b9c8ffbd tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.153482 May 09 20:30:31.191079 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 270/581] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:31 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:32.213081 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:32.213712 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:32.220102 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:32.220537 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:32.221298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:32.221733 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:32.370333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:32.378280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9457ae6d-5b37-4767-8e32-e61eaf785288 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.168913 May 09 20:30:32.388904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 312/582] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:32 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:32.966513 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4ff22352-bd46-47fa-acd0-7efbf2b0dd5f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:32.967018 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4ff22352-bd46-47fa-acd0-7efbf2b0dd5f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:32.972931 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff22352-bd46-47fa-acd0-7efbf2b0dd5f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:32.973377 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff22352-bd46-47fa-acd0-7efbf2b0dd5f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:32.974924 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff22352-bd46-47fa-acd0-7efbf2b0dd5f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:32.974924 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff22352-bd46-47fa-acd0-7efbf2b0dd5f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:32.999174 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4ff22352-bd46-47fa-acd0-7efbf2b0dd5f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5/ips" status: 200 len: 148 microversion: 2.1 time: 0.141897 May 09 20:30:32.999740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 271/583] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:30:32 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5/ips => generated 148 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:33.010421 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e08b9500-1329-4b86-a131-a7ed468112ff"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:33.011884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:33.017870 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.018319 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.019072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.019527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.094934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Invalid volume: volume e08b9500-1329-4b86-a131-a7ed468112ff is already attached to instances: fbed4907-edef-46b3-a625-306d3f840aae May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: POST /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5/os-volume_attachments HTTP/1.1 May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 74 May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:30:33.096685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {"volumeAttachment": {"volumeId": "e08b9500-1329-4b86-a131-a7ed468112ff"}} May 09 20:30:33.098150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Invalid volume: volume e08b9500-1329-4b86-a131-a7ed468112ff is already attached to instances: fbed4907-edef-46b3-a625-306d3f840aae May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'server_id': 'c597e2ce-b43c-488d-95b1-dbabe035c2b5', 'body': {'volumeAttachment': {'volumeId': 'e08b9500-1329-4b86-a131-a7ed468112ff'}}} May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e08b9500-1329-4b86-a131-a7ed468112ff is already attached to instances: fbed4907-edef-46b3-a625-306d3f840aae May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:33.098972 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e08b9500-1329-4b86-a131-a7ed468112ff is already attached to instances: fbed4907-edef-46b3-a625-306d3f840aae May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:33.100092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e08b9500-1329-4b86-a131-a7ed468112ff is already attached to instances: fbed4907-edef-46b3-a625-306d3f840aae May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 400 to user: Invalid volume: volume e08b9500-1329-4b86-a131-a7ed468112ff is already attached to instances: fbed4907-edef-46b3-a625-306d3f840aae {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c356c3ed-c519-4627-ae41-7757bf8cbf69 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091709 May 09 20:30:33.101262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 313/584] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:30:33 2022] POST /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 20:30:33.107723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:33.108212 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:33.114109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.114498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.115251 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.115710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.139751 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:30:33.218322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4a65d789-4edc-4777-992e-95bbcc41f6de tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 204 len: 0 microversion: 2.1 time: 0.114730 May 09 20:30:33.218950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 272/585] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:30:33 2022] DELETE /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:30:33.227298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:33.228258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:33.237627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.238068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.238828 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.239258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.373789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:33.381700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ed877916-f43c-438f-8261-a5fd70006b1f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1679 microversion: 2.1 time: 0.158414 May 09 20:30:33.382252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 314/586] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:33 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:33.396667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:33.397422 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:33.404048 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.404484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.405244 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:33.405667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:33.538326 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:33.545709 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-53d96b64-7b63-4109-9844-72f48014230b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.153267 May 09 20:30:33.546267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 273/587] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:33 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:34.399438 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:34.400040 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:34.406614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:34.407051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:34.407829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:34.408258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:34.534395 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:34.541725 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1fd6ce37-997c-4f3e-b544-c0d3a4a3ce21 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1679 microversion: 2.1 time: 0.146127 May 09 20:30:34.542281 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 315/588] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:34 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:34.562251 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:34.562865 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:34.570310 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:34.570791 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:34.571598 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:34.572028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:34.702096 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:34.709456 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c62a3853-8d07-4972-b8f7-b4b8f8127829 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.151430 May 09 20:30:34.710004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 274/589] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:34 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:35.561292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:35.561945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:35.568447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:35.568899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:35.569823 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:35.570262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:35.703042 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:35.710399 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-79c2e7cc-ac2c-4d8a-a274-d2dc12ea4037 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 200 len: 1679 microversion: 2.1 time: 0.153814 May 09 20:30:35.710956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 316/590] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:35 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:30:35.727682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:35.728285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:35.734608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:35.735052 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:35.735836 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:35.736267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:35.940620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:35.948115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-44eb39fc-65c6-45d6-ad1d-f6d0121887bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.224144 May 09 20:30:35.948810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 275/591] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:35 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:30:36.200690 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-4d7f158a-3a43-4a8d-84e5-df8147e7c940 req-fe19c7dc-fea0-42d3-8252-ea15279c55e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c597e2ce-b43c-488d-95b1-dbabe035c2b5", "name": "network-vif-deleted", "tag": "8210b103-2ad6-4969-8f18-c129db8dd1a3"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:36.209037 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-4d7f158a-3a43-4a8d-84e5-df8147e7c940 req-fe19c7dc-fea0-42d3-8252-ea15279c55e3 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:36.209720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-4d7f158a-3a43-4a8d-84e5-df8147e7c940 req-fe19c7dc-fea0-42d3-8252-ea15279c55e3 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:36.222014 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-4d7f158a-3a43-4a8d-84e5-df8147e7c940 req-fe19c7dc-fea0-42d3-8252-ea15279c55e3 service nova] Creating event network-vif-deleted:8210b103-2ad6-4969-8f18-c129db8dd1a3 for instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 on hv-cinder-83699 May 09 20:30:36.227479 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-4d7f158a-3a43-4a8d-84e5-df8147e7c940 req-fe19c7dc-fea0-42d3-8252-ea15279c55e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030564 May 09 20:30:36.228156 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 317/592] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:36.738273 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:36.738892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:36.751243 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:36.752047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:36.753974 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:36.754763 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:36.770840 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 HTTP/1.1 May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:30:36.773158 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:30:36.774459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'c597e2ce-b43c-488d-95b1-dbabe035c2b5'} May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:30:36.775227 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:30:36.776813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:30:36.778369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:30:36.778369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-41398c0b-f2f3-4390-b40c-855db9f9f4e0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 404 len: 111 microversion: 2.1 time: 0.050108 May 09 20:30:36.778369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 276/593] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:36 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 20:30:36.784622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1d418bd0-495b-4f7e-9321-2f70efeea2e1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '.version_select at 0x7f62bd4f04c0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:36.807889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1d418bd0-495b-4f7e-9321-2f70efeea2e1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663307979" status: 202 len: 0 microversion: 2.1 time: 0.027483 May 09 20:30:36.809568 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 318/594] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 20:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663307979 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:30:36.966780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:36.967429 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:36.983162 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:36.985059 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:36.986535 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:36.987327 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:37.498198 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:37.512772 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0b7e1b58-b2a7-46fa-8755-b868ace334f5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.549935 May 09 20:30:37.514355 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 277/595] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:36 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:37.838874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:37.839503 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:37.846554 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:37.846994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:37.847777 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:37.848649 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:37.931679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lazy-loading 'services' on Instance uuid fbed4907-edef-46b3-a625-306d3f840aae {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:30:38.002711 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ff28a747-0353-478d-84a6-d927781dbc06 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments/e08b9500-1329-4b86-a131-a7ed468112ff" status: 202 len: 0 microversion: 2.1 time: 0.167773 May 09 20:30:38.003300 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 319/596] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:30:37 2022] DELETE /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments/e08b9500-1329-4b86-a131-a7ed468112ff => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:30:38.012450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e066e76e-bf6a-4541-b0ee-2cdc8946ef17 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:38.013997 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e066e76e-bf6a-4541-b0ee-2cdc8946ef17 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:38.020738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e066e76e-bf6a-4541-b0ee-2cdc8946ef17 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:38.021182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e066e76e-bf6a-4541-b0ee-2cdc8946ef17 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:38.022150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e066e76e-bf6a-4541-b0ee-2cdc8946ef17 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:38.022581 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e066e76e-bf6a-4541-b0ee-2cdc8946ef17 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:38.054008 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e066e76e-bf6a-4541-b0ee-2cdc8946ef17 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 May 09 20:30:38.054581 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 278/597] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:30:38 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:30:38.531529 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:38.532620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:38.540508 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:38.540952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:38.541716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:38.542173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:38.682635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:38.690343 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-192384b1-ec67-4a76-9507-61fabc73a7bf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.164026 May 09 20:30:38.690939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 320/598] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:38 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:39.066013 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5fa7b179-54ca-4b60-921e-b2e4f7c17caf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:39.067018 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5fa7b179-54ca-4b60-921e-b2e4f7c17caf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:39.073644 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fa7b179-54ca-4b60-921e-b2e4f7c17caf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.075028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fa7b179-54ca-4b60-921e-b2e4f7c17caf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.076176 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fa7b179-54ca-4b60-921e-b2e4f7c17caf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.076616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5fa7b179-54ca-4b60-921e-b2e4f7c17caf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.106703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5fa7b179-54ca-4b60-921e-b2e4f7c17caf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044642 May 09 20:30:39.107275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 279/599] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:30:39 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 09 20:30:39.166494 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:39.167729 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:39.175028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.175624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.176456 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.176978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.204084 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:30:39.282657 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ab441eb6-7b7c-4a47-9281-0e26bd5a5e8b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 204 len: 0 microversion: 2.1 time: 0.119429 May 09 20:30:39.283374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 321/600] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:30:39 2022] DELETE /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:30:39.291487 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:39.292110 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:39.298099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.298546 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.299306 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.299831 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.431242 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:39.439127 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-aa7249c9-db3e-4800-8b2c-c6e65c85590f tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1681 microversion: 2.1 time: 0.151538 May 09 20:30:39.439725 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 280/601] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:39 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:39.708603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:39.709297 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:39.715239 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.715882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.716635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:39.717060 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:39.846837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:39.854053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ae3466ae-1cec-45a5-be2b-166e8db32e92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.149635 May 09 20:30:39.854948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 322/602] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:39 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:40.456519 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:40.457351 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:40.465648 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:40.466325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:40.466807 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:40.467452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:40.694703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:40.702532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-77ffa100-b076-4a4d-9549-24db2af11f42 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 200 len: 1681 microversion: 2.1 time: 0.249924 May 09 20:30:40.703091 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 281/603] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:40 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:40.873994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:40.874616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:40.881447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:40.881903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:40.882680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:40.883118 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:41.022555 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:41.031992 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-06ae3e61-871c-4a9f-b672-e73927995add tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.163596 May 09 20:30:41.032561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 323/604] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:40 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:41.142148 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-1e9c9e7b-51b2-42bd-a4e4-cfcb617a7228 req-b02bf5d0-e4b2-48ba-86d4-def533bf1fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbed4907-edef-46b3-a625-306d3f840aae", "name": "network-vif-deleted", "tag": "830153c9-f6de-4238-b8ca-24ec8e070f82"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:41.150682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-1e9c9e7b-51b2-42bd-a4e4-cfcb617a7228 req-b02bf5d0-e4b2-48ba-86d4-def533bf1fec service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:41.151120 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-1e9c9e7b-51b2-42bd-a4e4-cfcb617a7228 req-b02bf5d0-e4b2-48ba-86d4-def533bf1fec service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:41.164486 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-1e9c9e7b-51b2-42bd-a4e4-cfcb617a7228 req-b02bf5d0-e4b2-48ba-86d4-def533bf1fec service nova] Creating event network-vif-deleted:830153c9-f6de-4238-b8ca-24ec8e070f82 for instance fbed4907-edef-46b3-a625-306d3f840aae on hv-cinder-83699 May 09 20:30:41.170657 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-1e9c9e7b-51b2-42bd-a4e4-cfcb617a7228 req-b02bf5d0-e4b2-48ba-86d4-def533bf1fec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032197 May 09 20:30:41.171655 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 282/605] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:41.720502 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:41.721113 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:41.726960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:41.727446 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:41.728273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:41.728743 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:41.742420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae HTTP/1.1 May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:30:41.744079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:30:41.745588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': 'fbed4907-edef-46b3-a625-306d3f840aae'} May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:30:41.746466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:30:41.747821 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:41.748941 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:30:41.748941 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-64a0ebed-efae-4f39-a725-a4f0c118f768 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 404 len: 111 microversion: 2.1 time: 0.028924 May 09 20:30:41.749596 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 324/606] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:41 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:30:41.755756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-baa3e9a7-e8bb-48d3-bef5-80f2ed45eea3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '.version_select at 0x7f62bcbb5790>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:41.774415 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-baa3e9a7-e8bb-48d3-bef5-80f2ed45eea3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142749524" status: 202 len: 0 microversion: 2.1 time: 0.023254 May 09 20:30:41.774971 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 283/607] 10.222.0.44 () {58 vars in 1220 bytes} [Mon May 9 20:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142749524 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:30:42.050367 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:42.050986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:42.060579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:42.061028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:42.061796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:42.062275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:42.197153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:42.205687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4a990ad9-2866-4a90-b8bd-fd71c570b031 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1677 microversion: 2.1 time: 0.159621 May 09 20:30:42.206495 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 325/608] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:42 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:42.450759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2c75d14a-096f-4ac4-b46f-5ee05218ef6b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: .version_select at 0x7f62bcbfdc10>, body: {"keypair": {"name": "tempest-keypair-276896580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoa7ERivbBkNq5kkJMAYtV2h6p6ugEOvMWAP2Bx18LF/qDGtLbDR7Hft+tGc49NEqN3MD+rFMZwfZnb0M7dMrjMX2j9O3kfAOHkr0paWgvd+rXD15BcobesuSbN1ONOGg=="}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:42.464523 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-2c75d14a-096f-4ac4-b46f-5ee05218ef6b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:30:42.468341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-2c75d14a-096f-4ac4-b46f-5ee05218ef6b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:30:42.490709 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2c75d14a-096f-4ac4-b46f-5ee05218ef6b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043736 May 09 20:30:42.491258 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 284/609] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:30:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:43.224427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:43.225747 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:43.233305 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:43.233757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:43.234505 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:43.234935 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:43.436222 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:43.444512 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a320acee-14d3-4899-be9a-06490cdfcb87 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1654 microversion: 2.1 time: 0.223890 May 09 20:30:43.445076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 326/610] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:43 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1654 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:43.461471 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b440414d-b99f-41b1-a687-3d0ca5a44349 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:43.467724 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b440414d-b99f-41b1-a687-3d0ca5a44349 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:43.468175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b440414d-b99f-41b1-a687-3d0ca5a44349 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:43.491285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b440414d-b99f-41b1-a687-3d0ca5a44349 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Going to try to start instance {{(pid=116850) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 20:30:43.533885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b440414d-b99f-41b1-a687-3d0ca5a44349 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action" status: 202 len: 0 microversion: 2.1 time: 0.076612 May 09 20:30:43.534868 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 285/611] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:30:43 2022] POST /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:30:43.543894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:43.544521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:43.551597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:43.552051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:43.552852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:43.553265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:43.770398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:43.780719 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e881d20e-0f37-4158-b1c7-55a3a3b471b0 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1663 microversion: 2.1 time: 0.241656 May 09 20:30:43.781597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 327/612] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:43 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1663 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:43.831750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1019220622", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faed6f7c-f550-49ae-a092-e26879c69bec"}], "security_groups": [{"name": "tempest-securitygroup--1416937877"}], "key_name": "tempest-keypair-276896580", "user_data": "}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:43.991829 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] validate_networks() for [('faed6f7c-f550-49ae-a092-e26879c69bec', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:30:44.581080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:30:44.582623 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:30:44.583100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:30:44.583532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:30:44.583943 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:30:44.593841 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:44.594301 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:44.595101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:44.595557 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:44.612374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:30:44.616522 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:30:44.628175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:30:44.630526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:30:44.680620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-413bd4eb-e1a9-480e-98f2-fdb9ca527524 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.853634 May 09 20:30:44.681267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 286/613] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:30:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:30:44.692492 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6c9f67db-52bb-44ae-acd6-8669d53a1ec3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:44.693713 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6c9f67db-52bb-44ae-acd6-8669d53a1ec3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:44.751911 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6c9f67db-52bb-44ae-acd6-8669d53a1ec3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:44.758367 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6c9f67db-52bb-44ae-acd6-8669d53a1ec3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1241 microversion: 2.1 time: 0.069882 May 09 20:30:44.759176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 328/614] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:44 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:44.798856 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:44.799859 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:44.806877 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:44.807697 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:44.809549 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:44.810155 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:44.967420 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:44.975715 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8597b28e-b743-45b4-b516-08c38a02aac6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1663 microversion: 2.1 time: 0.180898 May 09 20:30:44.976290 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 287/615] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:44 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:45.776213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:45.776860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:45.784670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:45.785120 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:45.785882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:45.786316 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:45.863537 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:45.871233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-37127efa-dd7f-41c4-9856-c50548f40f6a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1293 microversion: 2.1 time: 0.098873 May 09 20:30:45.871829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 329/616] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:45 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:45.993899 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:45.994610 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:46.001306 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:46.002010 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:46.002791 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:46.003226 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:46.169900 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:46.177319 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-94332bd4-fc68-49f1-99dc-5adc948feb1d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1667 microversion: 2.1 time: 0.187340 May 09 20:30:46.177883 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 288/617] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:45 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1667 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:46.889396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:46.889999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:46.896396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:46.896896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:46.897603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:46.898034 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:47.029940 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:47.037277 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d8003748-48b7-44f4-8ae8-d4c93056b756 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.152647 May 09 20:30:47.037853 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 330/618] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:46 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:47.373992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-d0cabdbd-f480-4586-aad0-479805bdc4b4 req-29b8c6ca-fc5b-4403-81c8-4eaa4c4131e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19192fd8-c8e0-47e5-bff9-d1151fe03eb5", "tag": "56a3654f-3f83-4770-8cc6-c8d1a47c0985"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:47.386647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-d0cabdbd-f480-4586-aad0-479805bdc4b4 req-29b8c6ca-fc5b-4403-81c8-4eaa4c4131e7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:47.398449 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-d0cabdbd-f480-4586-aad0-479805bdc4b4 req-29b8c6ca-fc5b-4403-81c8-4eaa4c4131e7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:47.420815 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-d0cabdbd-f480-4586-aad0-479805bdc4b4 req-29b8c6ca-fc5b-4403-81c8-4eaa4c4131e7 service nova] Creating event network-changed:56a3654f-3f83-4770-8cc6-c8d1a47c0985 for instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 on hv-cinder-83699 May 09 20:30:47.426759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-d0cabdbd-f480-4586-aad0-479805bdc4b4 req-29b8c6ca-fc5b-4403-81c8-4eaa4c4131e7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056465 May 09 20:30:47.427370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 289/619] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:48.055573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:48.056195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:48.062790 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:48.063240 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:48.064037 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:48.064474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:48.200139 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:48.207573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8c73062b-458a-454d-b3b0-6bd0af8a39f3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.155863 May 09 20:30:48.208208 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 331/620] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:48 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:49.226948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:49.227711 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:49.235071 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:49.235660 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:49.236473 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:49.236918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:49.377208 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:49.384941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-90331182-07e5-4e74-9416-eebc3a13bd7c tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.162673 May 09 20:30:49.385499 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 290/621] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:49 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:50.403970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:50.404517 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:50.411261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:50.412410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:50.413121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:50.413552 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:50.557440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:50.567911 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7411295e-d9a8-4a66-90d2-a9a1ef838683 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.168045 May 09 20:30:50.569345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 332/622] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:50 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:51.586088 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:51.586732 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:51.594073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:51.594523 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:51.595325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:51.595781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:51.727976 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:51.736475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-98d82372-a9cd-4784-9001-0250660607d3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.154392 May 09 20:30:51.737912 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 291/623] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:51 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:52.479388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2b27d29e-d8d7-491d-a858-e1cb17cb0d98 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:52.480576 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2b27d29e-d8d7-491d-a858-e1cb17cb0d98 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:52.487447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b27d29e-d8d7-491d-a858-e1cb17cb0d98 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.487915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b27d29e-d8d7-491d-a858-e1cb17cb0d98 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.488670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b27d29e-d8d7-491d-a858-e1cb17cb0d98 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.489101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b27d29e-d8d7-491d-a858-e1cb17cb0d98 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.518160 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2b27d29e-d8d7-491d-a858-e1cb17cb0d98 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments/5d98d237-8134-49e7-be02-807f11b02214" status: 200 len: 194 microversion: 2.20 time: 0.150125 May 09 20:30:52.518729 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 333/624] 10.222.0.44 () {60 vars in 1453 bytes} [Mon May 9 20:30:52 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments/5d98d237-8134-49e7-be02-807f11b02214 => generated 194 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:30:52.583875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:52.584369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:52.591615 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.592169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.592824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.593252 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.674407 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lazy-loading 'services' on Instance uuid 425e8732-2c2b-4c37-b2c3-e766712d293f {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:30:52.752751 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5d4e4800-f18c-4421-a057-fcbbfead3270 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments/5d98d237-8134-49e7-be02-807f11b02214" status: 202 len: 0 microversion: 2.20 time: 0.172624 May 09 20:30:52.753805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 292/625] 10.222.0.44 () {60 vars in 1456 bytes} [Mon May 9 20:30:52 2022] DELETE /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments/5d98d237-8134-49e7-be02-807f11b02214 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 20:30:52.756975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:52.756975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:52.764693 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.765072 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c71d38f3-b773-4d96-863f-065fbbea4dca tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:52.765214 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.766972 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c71d38f3-b773-4d96-863f-065fbbea4dca tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:52.767169 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.767645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.778443 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c71d38f3-b773-4d96-863f-065fbbea4dca tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.778925 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c71d38f3-b773-4d96-863f-065fbbea4dca tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.780189 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c71d38f3-b773-4d96-863f-065fbbea4dca tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:52.780328 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c71d38f3-b773-4d96-863f-065fbbea4dca tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:52.816300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c71d38f3-b773-4d96-863f-065fbbea4dca tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057840 May 09 20:30:52.816876 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 293/626] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 9 20:30:52 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:30:52.916418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:52.925421 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-103eb782-e412-47cc-a3f2-16d371d959e6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.174977 May 09 20:30:52.926454 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 334/627] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:52 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:30:53.828053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5297968d-164c-4c58-8831-bddc60290264 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:53.829107 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5297968d-164c-4c58-8831-bddc60290264 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:53.835012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5297968d-164c-4c58-8831-bddc60290264 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:53.835493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5297968d-164c-4c58-8831-bddc60290264 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:53.836256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5297968d-164c-4c58-8831-bddc60290264 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:53.836692 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5297968d-164c-4c58-8831-bddc60290264 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:53.867456 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5297968d-164c-4c58-8831-bddc60290264 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044121 May 09 20:30:53.868012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 294/628] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 9 20:30:53 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:53.928394 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:53.928986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:53.935816 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:53.936266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:53.937088 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:53.937528 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:53.941710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:53.942319 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:53.948407 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:53.948876 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:53.949633 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:53.950059 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:53.962986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:30:54.061492 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-05c4f42b-7822-47bc-bb35-f2776da1ee91 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 204 len: 0 microversion: 2.20 time: 0.136493 May 09 20:30:54.065340 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 335/629] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 20:30:53 2022] DELETE /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 09 20:30:54.073392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:54.074909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:54.084403 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:54.084915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:54.085874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:54.086590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:54.101602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:54.109447 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-59016d66-7137-4705-a5df-d68c4b70be2b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.171407 May 09 20:30:54.119782 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 295/630] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:53 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:30:54.224285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:54.233339 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:54.234827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:54.236024 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5b34188b-8b04-454a-8df2-baca660ddd83 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.168263 May 09 20:30:54.248022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 336/631] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:30:54 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:30:55.127381 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:55.128011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:55.135309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:55.136432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:55.136914 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:55.137337 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:55.184905 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-614ca63e-e29f-47ca-b3b1-890ecc782a83 req-29d057f4-a1e0-475b-b821-4a36284e46a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19192fd8-c8e0-47e5-bff9-d1151fe03eb5", "name": "network-vif-plugged", "status": "completed", "tag": "56a3654f-3f83-4770-8cc6-c8d1a47c0985"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:55.193109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-614ca63e-e29f-47ca-b3b1-890ecc782a83 req-29d057f4-a1e0-475b-b821-4a36284e46a4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:55.193578 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-614ca63e-e29f-47ca-b3b1-890ecc782a83 req-29d057f4-a1e0-475b-b821-4a36284e46a4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:55.205156 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-614ca63e-e29f-47ca-b3b1-890ecc782a83 req-29d057f4-a1e0-475b-b821-4a36284e46a4 service nova] Creating event network-vif-plugged:56a3654f-3f83-4770-8cc6-c8d1a47c0985 for instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 on hv-cinder-83699 May 09 20:30:55.209901 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-614ca63e-e29f-47ca-b3b1-890ecc782a83 req-29d057f4-a1e0-475b-b821-4a36284e46a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093414 May 09 20:30:55.210794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 296/632] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:55.256711 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:55.257592 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:55.264611 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:55.265057 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:55.265823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:55.266253 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:55.271308 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:55.279677 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5aa1ea5b-d3fa-4c31-84ee-bcb0e4c4b3d5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.156026 May 09 20:30:55.280250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 337/633] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:55 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:55.395595 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:55.404148 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:55.405692 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:55.406781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9e125212-eef9-4863-ab44-b1b7aa06ad45 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.154335 May 09 20:30:55.407670 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 297/634] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:30:55 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:30:56.296709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:56.297252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:56.303580 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:56.304024 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:56.304783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:56.305208 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:56.424915 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:56.425527 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:56.431936 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:56.432376 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:56.433946 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:56.434395 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:56.437310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:56.444638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ec290ca4-9faf-49c0-8272-b19fc47287dd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1367 microversion: 2.1 time: 0.151900 May 09 20:30:56.445407 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 338/635] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:56 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:56.562364 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:56.570292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:56.571807 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:56.572977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a14f463a-0efd-467a-92e9-4f58a50c9cda tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1725 microversion: 2.20 time: 0.151943 May 09 20:30:56.573520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 298/636] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:30:56 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:30:57.462558 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:57.463176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:57.470732 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:57.471210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:57.471879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:57.472264 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:57.592328 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:57.593537 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:57.599919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:57.600358 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:57.601583 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:57.602013 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:57.610403 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:57.617893 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c97366e6-79f0-4c28-aae0-1b7157137c1a tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1557 microversion: 2.1 time: 0.159335 May 09 20:30:57.618761 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 339/637] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:30:57 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:30:57.634153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ffc3c259-4ffc-4b06-88ab-7f3eac08138d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:57.634717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ffc3c259-4ffc-4b06-88ab-7f3eac08138d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:57.641285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffc3c259-4ffc-4b06-88ab-7f3eac08138d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:57.641829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffc3c259-4ffc-4b06-88ab-7f3eac08138d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:57.642662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffc3c259-4ffc-4b06-88ab-7f3eac08138d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:57.643079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffc3c259-4ffc-4b06-88ab-7f3eac08138d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:57.687320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:57.695192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:57.696703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:30:57.697849 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-86222efd-9909-4c9c-97fb-c7c58b8585ee tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 200 len: 1657 microversion: 2.20 time: 0.110190 May 09 20:30:57.709013 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 299/638] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:30:57 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 1657 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:30:57.721291 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ffc3c259-4ffc-4b06-88ab-7f3eac08138d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090748 May 09 20:30:57.722040 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 340/639] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:30:57 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:30:57.802280 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-88470880-e6c5-4c96-be91-048d575f1d35 req-55c1c766-7193-4e7a-991f-0948c2fb11f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425e8732-2c2b-4c37-b2c3-e766712d293f", "name": "network-vif-deleted", "tag": "9d1946fe-d370-43ff-a7d4-5a7d9c20d2be"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:57.818463 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-88470880-e6c5-4c96-be91-048d575f1d35 req-55c1c766-7193-4e7a-991f-0948c2fb11f7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:57.819772 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-88470880-e6c5-4c96-be91-048d575f1d35 req-55c1c766-7193-4e7a-991f-0948c2fb11f7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:57.834835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-88470880-e6c5-4c96-be91-048d575f1d35 req-55c1c766-7193-4e7a-991f-0948c2fb11f7 service nova] Creating event network-vif-deleted:9d1946fe-d370-43ff-a7d4-5a7d9c20d2be for instance 425e8732-2c2b-4c37-b2c3-e766712d293f on hv-cinder-83699 May 09 20:30:57.841098 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-88470880-e6c5-4c96-be91-048d575f1d35 req-55c1c766-7193-4e7a-991f-0948c2fb11f7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042326 May 09 20:30:57.841941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 300/640] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:30:58.717299 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:58.719196 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:30:58.727169 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:58.727853 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:58.728801 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:58.729231 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:58.745558 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] HTTP exception thrown: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Request method failure captured: May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f HTTP/1.1 May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiTSlceEgDk15COdtvAeV5fCA0pjVy0soZz2xd8Nk5TXKKR7Y3aWDGIRTEZ7ueV0wf4LxW7ykfOadKZbdNKNv0cHo2I5DykNbGAOuscEpB8SBt43mqdw_QEqeMJ_6jqn6Voa1HCZy9TaucsUgV46yXw2XrodCNw8Q2L3S0J_cUuBxc May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Openstack-Nova-Api-Version: 2.20 May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: f579878e20bc40d282c9c38200581b98 May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:30:58.747179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f579878e20bc40d282c9c38200581b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f579878e20bc40d282c9c38200581b98"}]}] May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: f579878e20bc40d282c9c38200581b98 May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 38716aefb55246079de2658159fd5ca4 May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:30:58.748579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '425e8732-2c2b-4c37-b2c3-e766712d293f'} May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:30:58.752855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:30:58.754590 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:30:58.757389 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Returning 404 to user: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:30:58.757389 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-666d8cd9-5f33-451c-83be-e4cc4317eeec tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 404 len: 111 microversion: 2.20 time: 0.036668 May 09 20:30:58.757389 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 341/641] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:30:58 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 20:30:58.764683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-42c3a8ec-3a25-4c4f-ba07-86cc6872de99 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '.version_select at 0x7f62bcc3a550>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:30:58.785990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-42c3a8ec-3a25-4c4f-ba07-86cc6872de99 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595899172" status: 204 len: 0 microversion: 2.20 time: 0.026679 May 09 20:30:58.786572 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 301/642] 10.222.0.44 () {60 vars in 1261 bytes} [Mon May 9 20:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595899172 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 20:30:58.833243 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-1f6326b2-2cda-44e8-9d36-c0e303e64c33 req-275003d3-8eb4-49a8-ac2d-a99e4633fe40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19192fd8-c8e0-47e5-bff9-d1151fe03eb5", "tag": "56a3654f-3f83-4770-8cc6-c8d1a47c0985"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:58.842481 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-1f6326b2-2cda-44e8-9d36-c0e303e64c33 req-275003d3-8eb4-49a8-ac2d-a99e4633fe40 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:30:58.843285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-1f6326b2-2cda-44e8-9d36-c0e303e64c33 req-275003d3-8eb4-49a8-ac2d-a99e4633fe40 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:30:58.856508 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-1f6326b2-2cda-44e8-9d36-c0e303e64c33 req-275003d3-8eb4-49a8-ac2d-a99e4633fe40 service nova] Creating event network-changed:56a3654f-3f83-4770-8cc6-c8d1a47c0985 for instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 on hv-cinder-83699 May 09 20:30:58.863123 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-1f6326b2-2cda-44e8-9d36-c0e303e64c33 req-275003d3-8eb4-49a8-ac2d-a99e4633fe40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102787 May 09 20:30:58.864454 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 342/643] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:30:59.852507 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-85e5ecb1-b7b3-43bb-b8c5-6b18dfd01e3b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'create', calling method: .version_select at 0x7f62bcb30d30>, body: {"keypair": {"name": "tempest-keypair-575899967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVBNCrOScIdMhvYmLrdmPGCvfAjWjjWwipbzTeIyFOZ6lr3nFMvtRwn6MW1kK83AkLlAa8Zd6BoOK0J8FYUQBYjwvvB0pJwr6bvXqlKKWYkif5nv2igT3ELVNf74wBYsw=="}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:30:59.874331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-85e5ecb1-b7b3-43bb-b8c5-6b18dfd01e3b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for project f579878e20bc40d282c9c38200581b98. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:30:59.878379 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-85e5ecb1-b7b3-43bb-b8c5-6b18dfd01e3b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for user 38716aefb55246079de2658159fd5ca4 and project f579878e20bc40d282c9c38200581b98. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:30:59.900813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-85e5ecb1-b7b3-43bb-b8c5-6b18dfd01e3b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052180 May 09 20:30:59.901411 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 302/644] 10.222.0.44 () {62 vars in 1199 bytes} [Mon May 9 20:30:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 09 20:31:01.014846 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1669765603", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "879061ea-c49d-454e-abf2-ebb593b2f042"}], "security_groups": [{"name": "tempest-securitygroup--1638230144"}], "key_name": "tempest-keypair-575899967", "user_data": "}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:01.112925 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] validate_networks() for [('879061ea-c49d-454e-abf2-ebb593b2f042', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:31:01.515560 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:31:01.515980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:31:01.516720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:31:01.517319 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:31:01.517802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:31:01.527805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:01.528242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:01.529038 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:01.529464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:01.545682 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for project f579878e20bc40d282c9c38200581b98. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:31:01.549422 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Getting quotas for user 38716aefb55246079de2658159fd5ca4 and project f579878e20bc40d282c9c38200581b98. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:31:01.560363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:31:01.562687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:31:01.607740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-431efd39-609b-4eaa-a78d-06def0f7f0ad tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.598423 May 09 20:31:01.608434 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 343/645] 10.222.0.44 () {62 vars in 1187 bytes} [Mon May 9 20:31:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 20:31:01.618958 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5c342339-5cdf-46dd-9e1f-920cc4c8de04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:01.619885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5c342339-5cdf-46dd-9e1f-920cc4c8de04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:01.675119 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5c342339-5cdf-46dd-9e1f-920cc4c8de04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:01.682894 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5c342339-5cdf-46dd-9e1f-920cc4c8de04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:01.684595 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5c342339-5cdf-46dd-9e1f-920cc4c8de04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:01.686277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5c342339-5cdf-46dd-9e1f-920cc4c8de04 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1281 microversion: 2.20 time: 0.071161 May 09 20:31:01.686976 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 303/646] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:01 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:02.705122 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:02.705732 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:02.712481 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:02.712924 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:02.713679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:02.714138 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:02.775229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:02.782945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:02.784681 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:02.785771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ef47c70e-3b61-4b63-8567-5851f75afd10 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1339 microversion: 2.20 time: 0.084941 May 09 20:31:02.786324 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 344/647] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:02 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:03.803649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:03.804260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:03.813562 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:03.814001 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:03.814777 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:03.815209 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:03.968602 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-f94110df-6667-45a0-9b15-e68dec7c2edc req-cc9dbcad-4f20-4630-88b0-4bd7270972b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeee17c4-5609-4625-accc-1b95b2010b31", "tag": "96f29356-267d-448b-b032-8d87f2262256"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:03.995032 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-f94110df-6667-45a0-9b15-e68dec7c2edc req-cc9dbcad-4f20-4630-88b0-4bd7270972b8 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:03.996518 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-f94110df-6667-45a0-9b15-e68dec7c2edc req-cc9dbcad-4f20-4630-88b0-4bd7270972b8 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:04.009273 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-f94110df-6667-45a0-9b15-e68dec7c2edc req-cc9dbcad-4f20-4630-88b0-4bd7270972b8 service nova] Creating event network-changed:96f29356-267d-448b-b032-8d87f2262256 for instance eeee17c4-5609-4625-accc-1b95b2010b31 on hv-cinder-83699 May 09 20:31:04.014507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-f94110df-6667-45a0-9b15-e68dec7c2edc req-cc9dbcad-4f20-4630-88b0-4bd7270972b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049844 May 09 20:31:04.015597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 345/648] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:31:04.046668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:04.054678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:04.056210 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:04.057333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-51bec549-9a3b-4fa3-9df7-fe1f7129c48b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.257705 May 09 20:31:04.058023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 304/649] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:03 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:05.076605 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:05.077333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:05.083385 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:05.083860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:05.084614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:05.085048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:05.211904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:05.220072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:05.221559 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:05.222653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8bd3c484-6498-4567-baa8-823d6e03bc5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.150906 May 09 20:31:05.223209 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 346/650] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:05 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:06.241043 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:06.241659 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:06.248920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:06.249366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:06.250129 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:06.250561 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:06.379593 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:06.388075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:06.389665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:06.390768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d6024177-fe21-40da-baf2-b672f93275bb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.153607 May 09 20:31:06.391325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 305/651] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:06 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:07.409312 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:07.409964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:07.416221 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:07.416665 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:07.417418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:07.417850 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:07.548200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:07.555726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:07.557196 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:07.558278 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ed8b0ae8-2875-46f8-8990-12d1793f59c5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.152935 May 09 20:31:07.558837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 347/652] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:07 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:08.577067 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:08.577678 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:08.584105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:08.584550 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:08.585313 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:08.585744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:08.712090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:08.719959 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:08.721461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:08.722617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-99f354ab-9a86-4bed-912c-b502b8849f71 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.150211 May 09 20:31:08.723171 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 306/653] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:08 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:31:09.740305 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:09.740921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:09.747229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:09.747697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:09.748450 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:09.748876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:09.872778 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:09.880449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:09.881949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:09.883028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fdfa0e51-68f6-41e6-918e-df96df2df1f1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.146609 May 09 20:31:09.883620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 348/654] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:09 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:10.901893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:10.903101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:10.909379 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:10.909820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:10.910575 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:10.911007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:11.037234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:11.045235 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:11.046716 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:11.047842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6b3d42b9-f4be-4b64-9b57-da5404caffbe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.149902 May 09 20:31:11.048421 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 307/655] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:10 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:11.170937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-ebc04887-e2f0-4ce4-9467-14acb120eb3e req-65a7b03b-20dc-4f91-8a58-c232fd47256d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeee17c4-5609-4625-accc-1b95b2010b31", "name": "network-vif-plugged", "status": "completed", "tag": "96f29356-267d-448b-b032-8d87f2262256"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:11.179317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-ebc04887-e2f0-4ce4-9467-14acb120eb3e req-65a7b03b-20dc-4f91-8a58-c232fd47256d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:11.179809 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-ebc04887-e2f0-4ce4-9467-14acb120eb3e req-65a7b03b-20dc-4f91-8a58-c232fd47256d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:11.193856 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-ebc04887-e2f0-4ce4-9467-14acb120eb3e req-65a7b03b-20dc-4f91-8a58-c232fd47256d service nova] Creating event network-vif-plugged:96f29356-267d-448b-b032-8d87f2262256 for instance eeee17c4-5609-4625-accc-1b95b2010b31 on hv-cinder-83699 May 09 20:31:11.198721 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-ebc04887-e2f0-4ce4-9467-14acb120eb3e req-65a7b03b-20dc-4f91-8a58-c232fd47256d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031571 May 09 20:31:11.200412 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 349/656] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:12.065743 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:12.066347 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:12.072680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:12.073117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:12.073871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:12.074299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:12.200012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:12.207706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:12.209185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:12.210274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f9f0e251-b78b-476e-9a03-05a16bc90519 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1407 microversion: 2.20 time: 0.148477 May 09 20:31:12.210830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 308/657] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:12 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:13.228823 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:13.229507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:13.236284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:13.236716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:13.237464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:13.237890 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:13.365623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:13.373256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:13.374727 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:13.375953 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0b32433c-70f3-4454-9b39-2a135b3bc854 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1599 microversion: 2.20 time: 0.151350 May 09 20:31:13.376502 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 350/658] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:31:13 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:31:13.393521 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7f3c4b86-befd-496d-b58d-048094a9f353 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:13.394020 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7f3c4b86-befd-496d-b58d-048094a9f353 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:13.400283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f3c4b86-befd-496d-b58d-048094a9f353 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:13.400725 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f3c4b86-befd-496d-b58d-048094a9f353 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:13.401472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f3c4b86-befd-496d-b58d-048094a9f353 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:13.401894 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f3c4b86-befd-496d-b58d-048094a9f353 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:13.477105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7f3c4b86-befd-496d-b58d-048094a9f353 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087330 May 09 20:31:13.477720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 309/659] 10.222.0.44 () {60 vars in 1315 bytes} [Mon May 9 20:31:13 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:31:14.682487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-b2bac07c-9b8e-4444-a0dd-498a54c9820d req-22e96f09-7bef-4467-b62d-339f8dbd82ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeee17c4-5609-4625-accc-1b95b2010b31", "tag": "96f29356-267d-448b-b032-8d87f2262256"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:14.691298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b2bac07c-9b8e-4444-a0dd-498a54c9820d req-22e96f09-7bef-4467-b62d-339f8dbd82ed service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:14.691849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b2bac07c-9b8e-4444-a0dd-498a54c9820d req-22e96f09-7bef-4467-b62d-339f8dbd82ed service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:14.703096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-b2bac07c-9b8e-4444-a0dd-498a54c9820d req-22e96f09-7bef-4467-b62d-339f8dbd82ed service nova] Creating event network-changed:96f29356-267d-448b-b032-8d87f2262256 for instance eeee17c4-5609-4625-accc-1b95b2010b31 on hv-cinder-83699 May 09 20:31:14.708047 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-b2bac07c-9b8e-4444-a0dd-498a54c9820d req-22e96f09-7bef-4467-b62d-339f8dbd82ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029483 May 09 20:31:14.708717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 351/660] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:29.900702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:29.901210 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:29.907637 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:29.908080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:29.908836 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:29.909265 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:29.987201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lazy-loading 'services' on Instance uuid 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:31:30.057386 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7804e258-859c-49af-b5e6-b8e20f6b700b tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments/3415bcbf-2039-4638-be74-b947e42ded35" status: 202 len: 0 microversion: 2.1 time: 0.161010 May 09 20:31:30.057951 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 310/661] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:31:29 2022] DELETE /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments/3415bcbf-2039-4638-be74-b947e42ded35 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:31:30.067046 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3dace5e7-95de-4d2f-bb8e-aa7c0a665ab4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:30.068130 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3dace5e7-95de-4d2f-bb8e-aa7c0a665ab4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:30.075437 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3dace5e7-95de-4d2f-bb8e-aa7c0a665ab4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:30.075934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3dace5e7-95de-4d2f-bb8e-aa7c0a665ab4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:30.076727 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3dace5e7-95de-4d2f-bb8e-aa7c0a665ab4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:30.077141 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3dace5e7-95de-4d2f-bb8e-aa7c0a665ab4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:30.107164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3dace5e7-95de-4d2f-bb8e-aa7c0a665ab4 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 May 09 20:31:30.107677 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 352/662] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:31:30 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:31.118930 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3a7c0d1c-2c33-4aa3-a2c1-ba682c8acbbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:31.119947 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3a7c0d1c-2c33-4aa3-a2c1-ba682c8acbbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:31.127075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a7c0d1c-2c33-4aa3-a2c1-ba682c8acbbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:31.127557 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a7c0d1c-2c33-4aa3-a2c1-ba682c8acbbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:31.128324 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a7c0d1c-2c33-4aa3-a2c1-ba682c8acbbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:31.128756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a7c0d1c-2c33-4aa3-a2c1-ba682c8acbbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:31.157023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3a7c0d1c-2c33-4aa3-a2c1-ba682c8acbbd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042499 May 09 20:31:31.157568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 311/663] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:31:31 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:31:31.229131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:31.229660 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:31.236086 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:31.236515 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:31.237274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:31.237705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:31.262994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:31:31.335655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9faea3f8-6f26-46f3-9338-05dc8021c9e1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 204 len: 0 microversion: 2.1 time: 0.109983 May 09 20:31:31.336236 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 353/664] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:31:31 2022] DELETE /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:31:31.344205 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:31.344820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:31.350630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:31.351075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:31.351858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:31.352291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:31.486188 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:31.493666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d93a31b6-8b4d-459d-92b6-c8999f0ef5bd tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1688 microversion: 2.1 time: 0.153280 May 09 20:31:31.494233 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 312/665] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:31 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:31:32.512877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:32.513605 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:32.519898 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:32.520345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:32.521104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:32.521539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:32.650672 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:32.658594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f0c6fd06-5f0d-400a-9eab-ff8d2f3482f1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1688 microversion: 2.1 time: 0.150837 May 09 20:31:32.659190 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 354/666] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:32 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:33.675723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:33.676331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:33.682699 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:33.683256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:33.684249 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:33.684694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:33.809818 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:33.817075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3c44b07b-90d1-4c26-8fee-a10966b125c1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1688 microversion: 2.1 time: 0.145207 May 09 20:31:33.817633 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 313/667] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:33 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1688 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:34.834516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:34.835197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:34.841906 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:34.842381 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:34.843161 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:34.843632 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:34.970682 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:34.978007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6c858d93-f490-4405-8c4e-ab1578a29771 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1688 microversion: 2.1 time: 0.147681 May 09 20:31:34.978571 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 355/668] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:34 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:35.861990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-ca8ca2a1-bfc5-4d26-8bca-e736821223d1 req-8915d13b-6224-49b4-8356-5d972d669bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51484383-fe65-4cb3-9ed3-d42efa4bc5f9", "name": "network-vif-deleted", "tag": "e33030b9-6c9e-4361-9911-d23fdfcce223"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:35.873874 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-ca8ca2a1-bfc5-4d26-8bca-e736821223d1 req-8915d13b-6224-49b4-8356-5d972d669bdf service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:35.874317 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-ca8ca2a1-bfc5-4d26-8bca-e736821223d1 req-8915d13b-6224-49b4-8356-5d972d669bdf service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:35.886092 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-ca8ca2a1-bfc5-4d26-8bca-e736821223d1 req-8915d13b-6224-49b4-8356-5d972d669bdf service nova] Creating event network-vif-deleted:e33030b9-6c9e-4361-9911-d23fdfcce223 for instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 on hv-cinder-83699 May 09 20:31:35.895432 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-ca8ca2a1-bfc5-4d26-8bca-e736821223d1 req-8915d13b-6224-49b4-8356-5d972d669bdf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037105 May 09 20:31:35.896050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 314/669] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:35.997198 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:35.998094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:36.007106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:36.007581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:36.008577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:36.009010 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:36.047077 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:36.047550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:36.048006 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lazy-loading 'fault' on Instance uuid 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:31:36.096638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:36.103852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b9228767-ff54-4093-b743-09e5766f6fbc tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 200 len: 1335 microversion: 2.1 time: 0.112584 May 09 20:31:36.104423 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 356/670] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:35 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:37.122769 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:37.123518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 51484383-fe65-4cb3-9ed3-d42efa4bc5f9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:37.130152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:37.130588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:37.131339 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:37.131792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:37.144993 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] HTTP exception thrown: Instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 could not be found. May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Request method failure captured: May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 HTTP/1.1 May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiFsWQLIuO_MFnR6wXlqONSU-j1NHvohap0NnRPLJqroveZcYxwK4WYSQQ0nEZPDNIIOOvTvyXTOfii11W38YqbShW2XvMbKpI_IXPpfVP3e1dODEezPuqZyfDVKRs5HqTmMvCkOl-kqpmTiORx0H76ve0b1M7AbcA-BXbp9FC3xMY May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:31:37.146559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96a116cd334648f185dbf35bfa3ade00"}]}] May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 797d7c0dfda747549456236e9e639466 May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 could not be found. May 09 20:31:37.148134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '51484383-fe65-4cb3-9ed3-d42efa4bc5f9'} May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 could not be found. May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:31:37.148989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 could not be found. May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 could not be found. May 09 20:31:37.150232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:37.151315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Returning 404 to user: Instance 51484383-fe65-4cb3-9ed3-d42efa4bc5f9 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:31:37.151315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ff3d5f6e-cbb2-4fb8-8eb2-99382ee2d49e tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9" status: 404 len: 111 microversion: 2.1 time: 0.030503 May 09 20:31:37.151315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 315/671] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:37 2022] GET /compute/v2.1/servers/51484383-fe65-4cb3-9ed3-d42efa4bc5f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:31:37.157275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-00a56891-7744-48b4-89d6-d5ce13d6dc5f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '.version_select at 0x7f62bd66c0d0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:37.174366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-00a56891-7744-48b4-89d6-d5ce13d6dc5f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669099638" status: 202 len: 0 microversion: 2.1 time: 0.021603 May 09 20:31:37.174907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 357/672] 10.222.0.44 () {58 vars in 1220 bytes} [Mon May 9 20:31:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669099638 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:31:40.220371 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:40.220908 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:40.227129 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:40.227628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:40.228389 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:40.228822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:40.253563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:31:40.327674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0582d746-9f27-48f2-ac75-714b4292a9d3 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 204 len: 0 microversion: 2.1 time: 0.110886 May 09 20:31:40.328248 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 316/673] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:31:40 2022] DELETE /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:31:40.336524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:40.337162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:40.343558 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:40.344001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:40.344756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:40.345188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:40.471375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:40.478538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-844847e5-2ddd-467b-9ed0-6bb82a5b9348 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1508 microversion: 2.1 time: 0.146281 May 09 20:31:40.479090 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 358/674] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:40 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:41.498238 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-93569cbe-ae6d-4934-82f3-d2e6f1837f9c req-6fcf068f-3e4b-4d9e-add7-566a06fa7a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6", "name": "network-vif-deleted", "tag": "69ef2c60-07ae-4f03-b47c-0db178dcd214"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:41.499848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:41.500694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:41.509714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-93569cbe-ae6d-4934-82f3-d2e6f1837f9c req-6fcf068f-3e4b-4d9e-add7-566a06fa7a23 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:41.510218 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-93569cbe-ae6d-4934-82f3-d2e6f1837f9c req-6fcf068f-3e4b-4d9e-add7-566a06fa7a23 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:41.510965 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:41.512173 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:41.513398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:41.514183 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:41.529688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-93569cbe-ae6d-4934-82f3-d2e6f1837f9c req-6fcf068f-3e4b-4d9e-add7-566a06fa7a23 service nova] Creating event network-vif-deleted:69ef2c60-07ae-4f03-b47c-0db178dcd214 for instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 on hv-cinder-83699 May 09 20:31:41.537535 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-93569cbe-ae6d-4934-82f3-d2e6f1837f9c req-6fcf068f-3e4b-4d9e-add7-566a06fa7a23 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043534 May 09 20:31:41.539927 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 359/675] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:41.587467 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:41.595793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4ce68b4e-d750-4340-b03b-970e03d5160d tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 200 len: 1466 microversion: 2.1 time: 0.102894 May 09 20:31:41.596467 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 317/676] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:41 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 1466 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:42.613382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:42.614086 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:42.620638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:42.621087 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:42.621937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:42.622374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:42.635369 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] HTTP exception thrown: Instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 could not be found. May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Request method failure captured: May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 HTTP/1.1 May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiFsWQLIuO_MFnR6wXlqONSU-j1NHvohap0NnRPLJqroveZcYxwK4WYSQQ0nEZPDNIIOOvTvyXTOfii11W38YqbShW2XvMbKpI_IXPpfVP3e1dODEezPuqZyfDVKRs5HqTmMvCkOl-kqpmTiORx0H76ve0b1M7AbcA-BXbp9FC3xMY May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:31:42.637457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96a116cd334648f185dbf35bfa3ade00"}]}] May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 797d7c0dfda747549456236e9e639466 May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 could not be found. May 09 20:31:42.639015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6'} May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 could not be found. May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:31:42.639944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 could not be found. May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 could not be found. May 09 20:31:42.641429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:42.642697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Returning 404 to user: Instance 5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:31:42.642697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-774ee881-ac8d-4adf-89c2-6be1bd48a54f tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6" status: 404 len: 111 microversion: 2.1 time: 0.029609 May 09 20:31:42.642697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 360/677] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:42 2022] GET /compute/v2.1/servers/5b0b9df6-b5f8-4e0f-8f73-9cc82cc08fa6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:31:42.647131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:42.647655 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:42.654496 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:42.654937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:42.655718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:42.656145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:42.681817 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:31:42.754234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-98323965-e1db-4e22-8eff-7d92dd3ac362 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 204 len: 0 microversion: 2.1 time: 0.110471 May 09 20:31:42.754891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 318/678] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:31:42 2022] DELETE /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:31:42.764277 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:42.764883 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:42.770670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:42.771111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:42.771895 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:42.772323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:42.905645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:42.912733 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-11dec0ad-8deb-4f70-abe0-85187698b89c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.153285 May 09 20:31:42.913283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 361/679] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:42 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:43.930205 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:43.930826 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:43.937178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:43.937625 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:43.938380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:43.938809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:44.065559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:44.072784 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-adba2a73-d5c4-4a33-98f8-d514c1dfbfab tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.146865 May 09 20:31:44.073345 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 319/680] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:43 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:31:45.090318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:45.091050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:45.097547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:45.097993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:45.098754 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:45.099187 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:45.236548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:45.244176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5d6895ad-d726-47f1-8bcb-e00b54f82bfa tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1523 microversion: 2.1 time: 0.158256 May 09 20:31:45.244965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 362/681] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:45 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:45.827216 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-96e3ff5c-5616-485c-ac1b-c6bdead01b60 req-b1164cd5-ce05-4c9a-8159-5efc6ee8a8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a55e260a-09eb-4d67-9271-5fe7c21cab71", "name": "network-vif-deleted", "tag": "acace666-a7e8-4fa0-a252-9fd85656a35c"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:45.837039 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-96e3ff5c-5616-485c-ac1b-c6bdead01b60 req-b1164cd5-ce05-4c9a-8159-5efc6ee8a8b4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:45.837647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-96e3ff5c-5616-485c-ac1b-c6bdead01b60 req-b1164cd5-ce05-4c9a-8159-5efc6ee8a8b4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:45.851208 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-96e3ff5c-5616-485c-ac1b-c6bdead01b60 req-b1164cd5-ce05-4c9a-8159-5efc6ee8a8b4 service nova] Creating event network-vif-deleted:acace666-a7e8-4fa0-a252-9fd85656a35c for instance a55e260a-09eb-4d67-9271-5fe7c21cab71 on hv-cinder-83699 May 09 20:31:45.856383 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-96e3ff5c-5616-485c-ac1b-c6bdead01b60 req-b1164cd5-ce05-4c9a-8159-5efc6ee8a8b4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033777 May 09 20:31:45.856974 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 320/682] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:46.261086 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:46.263092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:46.269717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:46.270159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:46.270918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:46.271349 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:46.302881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:46.303332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:46.304154 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lazy-loading 'fault' on Instance uuid a55e260a-09eb-4d67-9271-5fe7c21cab71 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:31:46.345239 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d7c0dfda747549456236e9e639466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a116cd334648f185dbf35bfa3ade00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:46.351879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-becd83c9-27b9-4cd3-a606-65794fa8d24c tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 200 len: 1312 microversion: 2.1 time: 0.094842 May 09 20:31:46.352380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 363/683] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:46 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:31:47.369673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:47.370391 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] [instance: a55e260a-09eb-4d67-9271-5fe7c21cab71] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:47.377043 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:47.377483 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:47.378231 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:47.378657 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:47.392546 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] HTTP exception thrown: Instance a55e260a-09eb-4d67-9271-5fe7c21cab71 could not be found. May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Request method failure captured: May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 HTTP/1.1 May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiFsWQLIuO_MFnR6wXlqONSU-j1NHvohap0NnRPLJqroveZcYxwK4WYSQQ0nEZPDNIIOOvTvyXTOfii11W38YqbShW2XvMbKpI_IXPpfVP3e1dODEezPuqZyfDVKRs5HqTmMvCkOl-kqpmTiORx0H76ve0b1M7AbcA-BXbp9FC3xMY May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:31:47.394099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a116cd334648f185dbf35bfa3ade00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96a116cd334648f185dbf35bfa3ade00"}]}] May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 96a116cd334648f185dbf35bfa3ade00 May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-923663019 May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 797d7c0dfda747549456236e9e639466 May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-923663019-project May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance a55e260a-09eb-4d67-9271-5fe7c21cab71 could not be found. May 09 20:31:47.395683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'a55e260a-09eb-4d67-9271-5fe7c21cab71'} May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a55e260a-09eb-4d67-9271-5fe7c21cab71 could not be found. May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:31:47.396714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a55e260a-09eb-4d67-9271-5fe7c21cab71 could not be found. May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a55e260a-09eb-4d67-9271-5fe7c21cab71 could not be found. May 09 20:31:47.398113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:47.399584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] Returning 404 to user: Instance a55e260a-09eb-4d67-9271-5fe7c21cab71 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:31:47.399584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-caa9ff5e-0cfe-4764-b8cd-4b47c1bbe0a1 tempest-ServerRescueNegativeTestJSON-923663019 tempest-ServerRescueNegativeTestJSON-923663019-project] 10.222.0.44 "GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71" status: 404 len: 111 microversion: 2.1 time: 0.029961 May 09 20:31:47.399584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 321/684] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:47 2022] GET /compute/v2.1/servers/a55e260a-09eb-4d67-9271-5fe7c21cab71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:31:49.527974 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7dd0d404-2816-46e0-a5bd-1d4e1afd5f30 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:49.529085 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7dd0d404-2816-46e0-a5bd-1d4e1afd5f30 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:49.535207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7dd0d404-2816-46e0-a5bd-1d4e1afd5f30 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:49.535687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7dd0d404-2816-46e0-a5bd-1d4e1afd5f30 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:49.536460 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7dd0d404-2816-46e0-a5bd-1d4e1afd5f30 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:49.536898 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7dd0d404-2816-46e0-a5bd-1d4e1afd5f30 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:49.566096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7dd0d404-2816-46e0-a5bd-1d4e1afd5f30 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042550 May 09 20:31:49.571725 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 364/685] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:31:49 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:31:49.635118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:49.635938 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:49.642300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:49.642750 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:49.643541 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:49.643971 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:49.671877 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:31:49.761975 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1ca2815c-9d30-4913-bb23-2d1d28a7ba97 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 204 len: 0 microversion: 2.1 time: 0.129592 May 09 20:31:49.762963 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 322/686] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:31:49 2022] DELETE /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:31:49.771139 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:49.772680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:49.779454 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:49.779909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:49.780675 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:49.781282 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:50.055799 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:50.066745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-95f336ae-1639-4096-95b2-3411d32e7f26 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1673 microversion: 2.1 time: 0.299319 May 09 20:31:50.067882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 365/687] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:49 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1673 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:31:51.086166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:51.086970 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:51.093863 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:51.094501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:51.095384 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:51.095791 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:51.292076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:51.301776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7c4cbf38-799a-4b6e-ab63-b217d998704c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1673 microversion: 2.1 time: 0.219944 May 09 20:31:51.306602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 323/688] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:51 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:52.072236 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0581b517-5d5f-446c-a60f-fde0a6b79bc9 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Action: 'create', calling method: .version_select at 0x7f62bd3bfb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-773984710", "metadata": {"Type": "work"}}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:52.089293 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-f731bb64-1699-4f35-806e-8a083f618ace req-7fc15d4a-d635-4b87-9c5a-c13dcf2f6840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5859d0-753a-4eb6-9c16-6a21b2a0758b", "name": "network-vif-deleted", "tag": "8757cf9e-6828-4f88-b34e-3338c7176b27"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:52.102393 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-f731bb64-1699-4f35-806e-8a083f618ace req-7fc15d4a-d635-4b87-9c5a-c13dcf2f6840 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:52.103070 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-f731bb64-1699-4f35-806e-8a083f618ace req-7fc15d4a-d635-4b87-9c5a-c13dcf2f6840 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:52.117241 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-f731bb64-1699-4f35-806e-8a083f618ace req-7fc15d4a-d635-4b87-9c5a-c13dcf2f6840 service nova] Creating event network-vif-deleted:8757cf9e-6828-4f88-b34e-3338c7176b27 for instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b on hv-cinder-83699 May 09 20:31:52.125584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-f731bb64-1699-4f35-806e-8a083f618ace req-7fc15d4a-d635-4b87-9c5a-c13dcf2f6840 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040722 May 09 20:31:52.129515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 324/689] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:52.322078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:52.323165 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:52.333748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:52.336194 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:52.338058 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:52.340324 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:52.389377 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:52.389842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:52.390338 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lazy-loading 'fault' on Instance uuid 5e5859d0-753a-4eb6-9c16-6a21b2a0758b {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:31:52.439768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:52.451986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d764e0ad-c019-46a2-9791-79be268d1455 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 200 len: 1328 microversion: 2.1 time: 0.135148 May 09 20:31:52.453610 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 325/690] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:52 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 1328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:52.523843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0581b517-5d5f-446c-a60f-fde0a6b79bc9 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.587450 May 09 20:31:52.524998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 366/691] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 20:31:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 589 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 20:31:52.535905 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7a75f294-c53a-4066-b42a-6874d92a28aa tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Calling method '.version_select at 0x7f62bcaed700>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:52.607203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7a75f294-c53a-4066-b42a-6874d92a28aa tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461" status: 200 len: 352 microversion: 2.1 time: 0.075078 May 09 20:31:52.607987 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 326/692] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:31:52 2022] GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461 => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:53.470759 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:53.471366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:53.478185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:53.478627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:53.479380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:53.479834 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:53.492278 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] HTTP exception thrown: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Request method failure captured: May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b HTTP/1.1 May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiRrUBALhtmZfK00Ajz0Qk75020gmBV_LsvJju8vt5WOhIvoW3ZNBIURe69VPC0YFikl2zdReraJrYTKfkbLdgIPzb2z6gXM5rPf-a-gL6q4zogl3oESJAAEFLhs7PcJh5QLpl6q5QtoZsBULk1W6MDqmW36ZsRgbHAImL9vwOBB4o May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:31:53.493739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1689d104c0184a36816bb6e361733e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1689d104c0184a36816bb6e361733e16"}]}] May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeTestJSON-1635221143 May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: d9342c8759514113aeec13ce910e4a21 May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:31:53.495171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '5e5859d0-753a-4eb6-9c16-6a21b2a0758b'} May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:31:53.496447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:31:53.497806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:31:53.498985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Returning 404 to user: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:31:53.498985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-022eca3b-93d1-4c04-8dac-05ddab747d35 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 404 len: 111 microversion: 2.1 time: 0.028608 May 09 20:31:53.498985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 367/693] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:53 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:31:53.504428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a0125833-b822-4247-abd0-62d4a6274ecc tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '.version_select at 0x7f62bcb9b820>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:53.522292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a0125833-b822-4247-abd0-62d4a6274ecc tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215121233" status: 202 len: 0 microversion: 2.1 time: 0.022213 May 09 20:31:53.522780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 327/694] 10.222.0.44 () {58 vars in 1220 bytes} [Mon May 9 20:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215121233 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:31:53.619223 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-80256b4a-6fbf-4fae-80a5-f5122bd304b4 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Calling method '.version_select at 0x7f62bd4dd820>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:53.675279 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-80256b4a-6fbf-4fae-80a5-f5122bd304b4 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461" status: 200 len: 353 microversion: 2.1 time: 0.059682 May 09 20:31:53.682066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 368/695] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:31:53 2022] GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:53.688313 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06c4cb36-0d4d-473c-ab87-b1dbdde08ecd tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Calling method '.version_select at 0x7f62bcb53ee0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:53.737075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-06c4cb36-0d4d-473c-ab87-b1dbdde08ecd tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461" status: 200 len: 353 microversion: 2.1 time: 0.053462 May 09 20:31:53.737649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 328/696] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:31:53 2022] GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:53.754640 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4f7c1e46-3a6c-4aa1-9a94-0a6c5b03dd32 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Calling method '.version_select at 0x7f62bd3b30d0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:53.814374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4f7c1e46-3a6c-4aa1-9a94-0a6c5b03dd32 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461" status: 202 len: 0 microversion: 2.1 time: 0.063546 May 09 20:31:53.815026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 369/697] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:31:53 2022] DELETE /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:31:53.823017 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4bf738b8-2721-44ba-afa8-4950821a51fa tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Calling method '.version_select at 0x7f62bcb534c0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:53.871756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4bf738b8-2721-44ba-afa8-4950821a51fa tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461" status: 200 len: 352 microversion: 2.1 time: 0.052443 May 09 20:31:53.872419 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 329/698] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:31:53 2022] GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:54.163962 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-885714fa-e3c8-4035-ade2-bc49444e134d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'create', calling method: .version_select at 0x7f62bd3b3040>, body: {"keypair": {"name": "tempest-keypair-1467466994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF4RK47nFxruD3Dr4CUKUUcCukhLeO2CNRf5eqAgKO1j57L8XdYJChamBSXouAmjmSv0fxz3lAnuGNsPdNn52DuzUnVtpmyvPLepiGN4PWGoXP5vibyWrWoPs7sYLOlOg=="}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:54.178533 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-885714fa-e3c8-4035-ade2-bc49444e134d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for project 1689d104c0184a36816bb6e361733e16. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:31:54.182281 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-885714fa-e3c8-4035-ade2-bc49444e134d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for user d9342c8759514113aeec13ce910e4a21 and project 1689d104c0184a36816bb6e361733e16. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:31:54.204057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-885714fa-e3c8-4035-ade2-bc49444e134d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043951 May 09 20:31:54.204826 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 370/699] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:31:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:54.885203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aed11e77-d8c8-48e8-b0f5-fdb5e564cde9 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Calling method '.version_select at 0x7f62bcd9e9d0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:54.912672 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-aed11e77-d8c8-48e8-b0f5-fdb5e564cde9 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] HTTP exception thrown: Volume 2b36aaa6-a846-49d7-8087-2907e1e99461 could not be found. May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aed11e77-d8c8-48e8-b0f5-fdb5e564cde9 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Request method failure captured: May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461 HTTP/1.1 May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXo3c2rdSnkmiIa_q1Sz2PxoZ4zMiRlWNlQ_Xbtl0duPHqymHARI-qergp-8_zVMD1I5536RxpHZeqdxDc8YVsS4WTgkGd1_4gkIQ6OFFzHYh2dEDHaCXCMvExK9gAaDQXGoFlRZ0dljx0dde68DMK9QnnXNMFl-5uA2seMKzBSdpoM May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: bfb229f346ea497198df7849bcc3108b May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesGetTestJSON-124462394 May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:31:54.914789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bfb229f346ea497198df7849bcc3108b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bfb229f346ea497198df7849bcc3108b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bfb229f346ea497198df7849bcc3108b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bfb229f346ea497198df7849bcc3108b"}]}] May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesGetTestJSON-124462394 May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: bfb229f346ea497198df7849bcc3108b May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesGetTestJSON-124462394 May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesGetTestJSON-124462394-project May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: b1bebfce9d894c1ea5f86a18b16d4d54 May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesGetTestJSON-124462394-project May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Volume 2b36aaa6-a846-49d7-8087-2907e1e99461 could not be found. May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '2b36aaa6-a846-49d7-8087-2907e1e99461'} May 09 20:31:54.916240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b36aaa6-a846-49d7-8087-2907e1e99461 could not be found. (HTTP 404) (Request-ID: req-607b894a-297b-4181-838c-6ff13d9b2dba) May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:54.917234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:31:54.918679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b36aaa6-a846-49d7-8087-2907e1e99461 could not be found. May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 20:31:54.920279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b36aaa6-a846-49d7-8087-2907e1e99461 could not be found. May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b36aaa6-a846-49d7-8087-2907e1e99461 could not be found. May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aed11e77-d8c8-48e8-b0f5-fdb5e564cde9 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] Returning 404 to user: Volume 2b36aaa6-a846-49d7-8087-2907e1e99461 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-aed11e77-d8c8-48e8-b0f5-fdb5e564cde9 tempest-VolumesGetTestJSON-124462394 tempest-VolumesGetTestJSON-124462394-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461" status: 404 len: 109 microversion: 2.1 time: 0.036294 May 09 20:31:54.921745 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 330/700] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:31:54 2022] GET /compute/v2.1/os-volumes/2b36aaa6-a846-49d7-8087-2907e1e99461 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:31:55.715298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1054600998", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f375c59-80e0-462b-90e2-c85c57ac95d7"}], "security_groups": [{"name": "tempest-securitygroup--1534035065"}], "key_name": "tempest-keypair-1467466994", "user_data": "}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:55.813542 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] validate_networks() for [('7f375c59-80e0-462b-90e2-c85c57ac95d7', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:31:56.187868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:31:56.188347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:31:56.188828 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:31:56.189232 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:31:56.189638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:31:56.198270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:56.198746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:56.199787 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:56.200227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:56.217295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for project 1689d104c0184a36816bb6e361733e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:31:56.221395 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Getting quotas for user d9342c8759514113aeec13ce910e4a21 and project 1689d104c0184a36816bb6e361733e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:31:56.232474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:31:56.234819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:31:56.283113 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3c8a8e22-2c0a-47b9-82cc-ffe61c907958 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.572977 May 09 20:31:56.287514 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 371/701] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:31:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:31:56.296135 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-dc4ae139-a49c-4719-bc4c-36aa10a081c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:56.297391 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-dc4ae139-a49c-4719-bc4c-36aa10a081c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:56.352517 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-dc4ae139-a49c-4719-bc4c-36aa10a081c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:56.359450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-dc4ae139-a49c-4719-bc4c-36aa10a081c6 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1238 microversion: 2.1 time: 0.068906 May 09 20:31:56.360215 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 331/702] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:56 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:31:57.376355 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:57.376971 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:57.382915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:57.383365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:57.384162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:57.384600 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:57.445852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:57.453283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e4d50a37-c27c-4a9d-919d-f57ab6f7de99 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1296 microversion: 2.1 time: 0.081340 May 09 20:31:57.453848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 372/703] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:57 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:58.470892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:58.471542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:58.477739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:58.478185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:58.478959 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:58.479413 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:58.678089 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-dc7d30ca-dafa-42a6-84c7-7c4252446f7f req-a825c972-3673-491b-8129-6f54a72988c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd76c99-66dc-4600-8826-0c5b607eded9", "tag": "19962f6a-e324-4cc2-9939-36268c0cdce1"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:31:58.687999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-dc7d30ca-dafa-42a6-84c7-7c4252446f7f req-a825c972-3673-491b-8129-6f54a72988c7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:58.688522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-dc7d30ca-dafa-42a6-84c7-7c4252446f7f req-a825c972-3673-491b-8129-6f54a72988c7 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:58.704882 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:58.711583 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-dc7d30ca-dafa-42a6-84c7-7c4252446f7f req-a825c972-3673-491b-8129-6f54a72988c7 service nova] Creating event network-changed:19962f6a-e324-4cc2-9939-36268c0cdce1 for instance 4cd76c99-66dc-4600-8826-0c5b607eded9 on hv-cinder-83699 May 09 20:31:58.712976 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-00b81ef4-ea80-4dbb-b85e-0d2cb644129c tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.246407 May 09 20:31:58.713622 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 332/704] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:58 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:31:58.727262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-dc7d30ca-dafa-42a6-84c7-7c4252446f7f req-a825c972-3673-491b-8129-6f54a72988c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053185 May 09 20:31:58.728111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 373/705] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:31:59.730025 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:31:59.730639 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:31:59.737181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:59.737626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:59.738381 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:31:59.738837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:31:59.863150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:31:59.870284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-90cc9164-f9cd-4414-87c0-1e9835dc4c0f tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.144154 May 09 20:31:59.870844 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 333/706] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:31:59 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:00.888375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:00.889071 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:00.895768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:00.896222 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:00.896985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:00.897425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:01.026240 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:01.033498 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0e8825f2-4f23-4e17-81ab-76a1fa405a3e tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.149520 May 09 20:32:01.033987 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 374/707] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:00 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:02.050455 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:02.051064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:02.057301 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:02.057739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:02.058488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:02.058914 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:02.194867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:02.203161 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7122784a-b760-4923-8b7b-a83f16bfc750 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.156580 May 09 20:32:02.203835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 334/708] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:02 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:03.221325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:03.221921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:03.228534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:03.229001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:03.229813 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:03.230307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:03.362740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:03.371713 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-25029e86-2cee-4e47-b9ab-a57152e3f157 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.154154 May 09 20:32:03.373457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 375/709] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:03 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:04.390857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:04.391500 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:04.397851 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:04.398299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:04.399058 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:04.399530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:04.525885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:04.533070 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e1aef64b-dd86-441c-824a-8c684860cd12 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.147065 May 09 20:32:04.533634 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 335/710] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:04 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:05.550944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:05.551701 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:05.558011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:05.558523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:05.559335 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:05.560543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:05.712862 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:05.720842 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8f22426c-d0cb-4ffa-91d1-535edaac7db4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.173971 May 09 20:32:05.721407 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 376/711] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:05 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:32:06.744167 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:06.744805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:06.752168 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:06.752619 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:06.753390 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:06.753828 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:06.884095 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:06.891930 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-aed457e3-c56f-49aa-9447-9434394a4bc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.151587 May 09 20:32:06.892489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 336/712] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:06 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:32:07.909685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:07.910445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:07.918186 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:07.918830 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:07.919839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:07.920366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:08.061927 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:08.069200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8cd757c5-6906-4eae-ab9a-0fa784331426 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.164242 May 09 20:32:08.069756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 377/713] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:07 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:09.087972 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:09.088608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:09.095444 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:09.095939 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:09.096776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:09.097742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:09.330966 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:09.338718 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6573ed32-3a88-41ae-9775-6d756ce2e3e1 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.254816 May 09 20:32:09.339323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 337/714] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:09 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:10.355878 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:10.357296 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:10.363676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:10.364202 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:10.365035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:10.365554 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:10.527564 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:10.537001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a7389798-15d0-4d16-bfcd-42c549e8be9d tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.184837 May 09 20:32:10.537572 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 378/715] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:10 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:10.669951 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-02a9bdfb-b5c6-4daf-bde4-89cc3a0fbfa4 req-e90894cb-c10c-431a-853b-cc6fb196c75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd76c99-66dc-4600-8826-0c5b607eded9", "name": "network-vif-plugged", "status": "completed", "tag": "19962f6a-e324-4cc2-9939-36268c0cdce1"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:32:10.679055 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-02a9bdfb-b5c6-4daf-bde4-89cc3a0fbfa4 req-e90894cb-c10c-431a-853b-cc6fb196c75b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:10.679558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-02a9bdfb-b5c6-4daf-bde4-89cc3a0fbfa4 req-e90894cb-c10c-431a-853b-cc6fb196c75b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:10.692582 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-02a9bdfb-b5c6-4daf-bde4-89cc3a0fbfa4 req-e90894cb-c10c-431a-853b-cc6fb196c75b service nova] Creating event network-vif-plugged:19962f6a-e324-4cc2-9939-36268c0cdce1 for instance 4cd76c99-66dc-4600-8826-0c5b607eded9 on hv-cinder-83699 May 09 20:32:10.697681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-02a9bdfb-b5c6-4daf-bde4-89cc3a0fbfa4 req-e90894cb-c10c-431a-853b-cc6fb196c75b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 May 09 20:32:10.698441 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 338/716] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:32:11.554650 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:11.555296 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:11.562055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:11.562500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:11.563298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:11.563748 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:11.693795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:11.701734 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5d6e6382-9e4f-458d-8124-8ce16e5daf91 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.150915 May 09 20:32:11.702297 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 379/717] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:11 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:32:12.719181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:12.719916 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:12.726058 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:12.726521 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:12.727274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:12.727734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:12.859136 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:12.866346 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-565e25e5-550b-4568-8345-b5815b2b0adf tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.152028 May 09 20:32:12.866939 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 339/718] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:12 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:13.884399 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:13.884939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:13.892366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:13.892810 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:13.893568 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:13.893999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:14.025289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:14.032625 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9fc7a062-a83b-4582-b5ff-e90540c5bfc3 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.152254 May 09 20:32:14.033177 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 380/719] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:13 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:15.049496 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:15.050090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:15.056450 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:15.056904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:15.057660 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:15.058099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:15.194752 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:15.202547 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-12ca96b0-c0f2-4325-843d-a1ac3d5317c9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.156898 May 09 20:32:15.203097 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 340/720] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:15 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:16.221362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:16.221996 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:16.228298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:16.228740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:16.229489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:16.229917 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:16.356222 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:16.363310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6729934c-78b4-4219-8a33-a0827178d91b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1364 microversion: 2.1 time: 0.146666 May 09 20:32:16.363890 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 381/721] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:16 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:17.379948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:17.380563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:17.387698 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:17.388293 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:17.388998 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:17.389425 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:17.514568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:32:17.522036 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-42dfd8b7-7d1a-4bf2-a251-74169732496b tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1549 microversion: 2.1 time: 0.145983 May 09 20:32:17.522596 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 341/722] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:32:17 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:32:17.538627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-24cd29b7-a8f7-486d-83ef-80ab0e0fe6a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:17.539138 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-24cd29b7-a8f7-486d-83ef-80ab0e0fe6a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:17.545479 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-24cd29b7-a8f7-486d-83ef-80ab0e0fe6a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:17.545924 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-24cd29b7-a8f7-486d-83ef-80ab0e0fe6a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:17.546680 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-24cd29b7-a8f7-486d-83ef-80ab0e0fe6a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:17.547110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-24cd29b7-a8f7-486d-83ef-80ab0e0fe6a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:17.626270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-24cd29b7-a8f7-486d-83ef-80ab0e0fe6a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091355 May 09 20:32:17.626853 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 382/723] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:32:17 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:32:18.592479 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-2e6b5647-d53a-4ee1-8bab-6ceffbc10490 req-d41f05e0-344f-4e3c-a1a4-87873843ceb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd76c99-66dc-4600-8826-0c5b607eded9", "tag": "19962f6a-e324-4cc2-9939-36268c0cdce1"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:32:18.601022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-2e6b5647-d53a-4ee1-8bab-6ceffbc10490 req-d41f05e0-344f-4e3c-a1a4-87873843ceb0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:18.601544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-2e6b5647-d53a-4ee1-8bab-6ceffbc10490 req-d41f05e0-344f-4e3c-a1a4-87873843ceb0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:18.613710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-2e6b5647-d53a-4ee1-8bab-6ceffbc10490 req-d41f05e0-344f-4e3c-a1a4-87873843ceb0 service nova] Creating event network-changed:19962f6a-e324-4cc2-9939-36268c0cdce1 for instance 4cd76c99-66dc-4600-8826-0c5b607eded9 on hv-cinder-83699 May 09 20:32:18.618771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-2e6b5647-d53a-4ee1-8bab-6ceffbc10490 req-d41f05e0-344f-4e3c-a1a4-87873843ceb0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030947 May 09 20:32:18.619459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 342/724] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:32:52.348831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5d70f03b-da30-4ab5-964d-2b0adf46586d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:32:52.349420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5d70f03b-da30-4ab5-964d-2b0adf46586d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:52.355198 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d70f03b-da30-4ab5-964d-2b0adf46586d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:52.355698 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d70f03b-da30-4ab5-964d-2b0adf46586d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:52.356439 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d70f03b-da30-4ab5-964d-2b0adf46586d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:52.356876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5d70f03b-da30-4ab5-964d-2b0adf46586d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:52.385022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5d70f03b-da30-4ab5-964d-2b0adf46586d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.040990 May 09 20:32:52.385841 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 383/725] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:32:52 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:32:53.760211 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5d91ce1c-1c75-4375-81b8-2f389c2ee990 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce6e4d5a-4dd1-44ab-ab9a-3756d840554b"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:32:53.761593 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5d91ce1c-1c75-4375-81b8-2f389c2ee990 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:32:53.768269 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d91ce1c-1c75-4375-81b8-2f389c2ee990 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:53.768706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d91ce1c-1c75-4375-81b8-2f389c2ee990 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:53.769452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d91ce1c-1c75-4375-81b8-2f389c2ee990 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:32:53.769877 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5d91ce1c-1c75-4375-81b8-2f389c2ee990 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:32:54.002088 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5d91ce1c-1c75-4375-81b8-2f389c2ee990 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246726 May 09 20:32:54.002691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 343/726] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:32:53 2022] POST /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:01.481650 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce6e4d5a-4dd1-44ab-ab9a-3756d840554b"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:01.482753 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:01.489151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:01.489617 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:01.490369 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:01.490794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:01.565188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Invalid volume: volume ce6e4d5a-4dd1-44ab-ab9a-3756d840554b is already attached to instances: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: POST /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments HTTP/1.1 May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 74 May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:33:01.566980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {"volumeAttachment": {"volumeId": "ce6e4d5a-4dd1-44ab-ab9a-3756d840554b"}} May 09 20:33:01.568601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Invalid volume: volume ce6e4d5a-4dd1-44ab-ab9a-3756d840554b is already attached to instances: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'server_id': '19192fd8-c8e0-47e5-bff9-d1151fe03eb5', 'body': {'volumeAttachment': {'volumeId': 'ce6e4d5a-4dd1-44ab-ab9a-3756d840554b'}}} May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce6e4d5a-4dd1-44ab-ab9a-3756d840554b is already attached to instances: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:01.569410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce6e4d5a-4dd1-44ab-ab9a-3756d840554b is already attached to instances: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:01.570703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce6e4d5a-4dd1-44ab-ab9a-3756d840554b is already attached to instances: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 400 to user: Invalid volume: volume ce6e4d5a-4dd1-44ab-ab9a-3756d840554b is already attached to instances: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-de94522c-8153-4d48-9f5a-69be17a5d970 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090727 May 09 20:33:01.572110 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 384/727] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:33:01 2022] POST /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 20:33:01.630466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:01.631058 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:01.638094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:01.638601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:01.640035 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:01.640537 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:01.722513 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lazy-loading 'services' on Instance uuid 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:33:01.793144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-698ca899-8be2-4a04-8bf1-7fb2298f8eef tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments/ce6e4d5a-4dd1-44ab-ab9a-3756d840554b" status: 202 len: 0 microversion: 2.1 time: 0.167900 May 09 20:33:01.793736 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 344/728] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:33:01 2022] DELETE /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments/ce6e4d5a-4dd1-44ab-ab9a-3756d840554b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:33:01.802347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f47ed345-4cb6-45e1-b85d-003181048312 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:01.803534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f47ed345-4cb6-45e1-b85d-003181048312 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:01.810388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f47ed345-4cb6-45e1-b85d-003181048312 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:01.812434 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f47ed345-4cb6-45e1-b85d-003181048312 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:01.813244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f47ed345-4cb6-45e1-b85d-003181048312 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:01.813675 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f47ed345-4cb6-45e1-b85d-003181048312 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:01.846755 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f47ed345-4cb6-45e1-b85d-003181048312 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048165 May 09 20:33:01.847605 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 385/729] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:33:01 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:02.860260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-38cfab1a-faa8-4a8f-9097-2b9e69feb9bf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:02.861225 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-38cfab1a-faa8-4a8f-9097-2b9e69feb9bf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:02.867544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cfab1a-faa8-4a8f-9097-2b9e69feb9bf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:02.867983 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cfab1a-faa8-4a8f-9097-2b9e69feb9bf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:02.868729 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cfab1a-faa8-4a8f-9097-2b9e69feb9bf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:02.869155 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cfab1a-faa8-4a8f-9097-2b9e69feb9bf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:02.896776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-38cfab1a-faa8-4a8f-9097-2b9e69feb9bf tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041976 May 09 20:33:02.897320 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 345/730] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:33:02 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:33:02.953154 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:02.953666 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:02.959897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:02.960344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:02.961158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:02.961595 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:02.986537 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:33:03.066241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ccf95b3b-1ed8-403a-962c-0f94217541d2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 204 len: 0 microversion: 2.1 time: 0.117087 May 09 20:33:03.066999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 386/731] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:33:02 2022] DELETE /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:33:03.075331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:03.076216 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:03.082807 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:03.083322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:03.084230 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:03.084737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:03.224322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:03.232792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a7f087fc-6f75-4c5c-a805-8db3fa4c3731 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1681 microversion: 2.1 time: 0.161263 May 09 20:33:03.233642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 346/732] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:03 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:04.250904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:04.251631 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:04.257534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:04.257975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:04.258724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:04.259149 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:04.395066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:04.402566 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d9dd9150-bfc2-4e88-80ff-293e2f4f5317 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1681 microversion: 2.1 time: 0.156144 May 09 20:33:04.403211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 387/733] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:04 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:05.298919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:33:05.299766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:33:05.421860 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:05.422526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:05.428775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:05.429218 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:05.429982 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:05.430407 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:05.625445 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:05.633130 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-04a1f9b8-5a55-4c4d-9623-823b48856cc2 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 200 len: 1681 microversion: 2.1 time: 0.215193 May 09 20:33:05.634014 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 347/734] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:05 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:05.962445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-f09c6596-fc3b-452b-84b5-76f162042411 req-9b709e34-70ee-45d6-9ca9-810634fc3b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19192fd8-c8e0-47e5-bff9-d1151fe03eb5", "name": "network-vif-deleted", "tag": "56a3654f-3f83-4770-8cc6-c8d1a47c0985"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:05.971980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-f09c6596-fc3b-452b-84b5-76f162042411 req-9b709e34-70ee-45d6-9ca9-810634fc3b99 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:05.972418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-f09c6596-fc3b-452b-84b5-76f162042411 req-9b709e34-70ee-45d6-9ca9-810634fc3b99 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:05.984104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-f09c6596-fc3b-452b-84b5-76f162042411 req-9b709e34-70ee-45d6-9ca9-810634fc3b99 service nova] Creating event network-vif-deleted:56a3654f-3f83-4770-8cc6-c8d1a47c0985 for instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 on hv-cinder-83699 May 09 20:33:05.989302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-f09c6596-fc3b-452b-84b5-76f162042411 req-9b709e34-70ee-45d6-9ca9-810634fc3b99 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030477 May 09 20:33:05.990282 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 388/735] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:06.651142 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:06.651798 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:06.659147 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:06.659810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:06.660662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:06.661318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:06.676454 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 HTTP/1.1 May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:33:06.678109 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:33:06.679740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '19192fd8-c8e0-47e5-bff9-d1151fe03eb5'} May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:33:06.680702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:33:06.682152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:33:06.684181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:33:06.685032 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d720c5e0-6204-453e-85a6-231f04258680 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 404 len: 111 microversion: 2.1 time: 0.037846 May 09 20:33:06.685586 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 348/736] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:06 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:33:06.696104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2f68898a-2e8d-40f4-a7bb-3e3db3b2170d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '.version_select at 0x7f62bd4f08b0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:06.719482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2f68898a-2e8d-40f4-a7bb-3e3db3b2170d tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-276896580" status: 202 len: 0 microversion: 2.1 time: 0.027498 May 09 20:33:06.720061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 389/737] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 20:33:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-276896580 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 20:33:07.552917 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b3d4596f-d45d-42bc-9963-0779185e188a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:07.553522 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b3d4596f-d45d-42bc-9963-0779185e188a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:07.559533 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3d4596f-d45d-42bc-9963-0779185e188a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:07.560299 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3d4596f-d45d-42bc-9963-0779185e188a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:07.561309 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3d4596f-d45d-42bc-9963-0779185e188a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:07.561817 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3d4596f-d45d-42bc-9963-0779185e188a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:07.587557 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b3d4596f-d45d-42bc-9963-0779185e188a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/ips" status: 200 len: 151 microversion: 2.20 time: 0.038434 May 09 20:33:07.589577 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 349/738] 10.222.0.44 () {60 vars in 1288 bytes} [Mon May 9 20:33:07 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:33:07.809363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-115936ca-a91e-44a5-92bb-8d47ef2e1168 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: .version_select at 0x7f62bd3bf4c0>, body: {"keypair": {"name": "tempest-keypair-1586583854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtlRVa2sAY+GfZ7QUYDiV0a68/aWhKftjwkq0dMQsmFxzeIv0C1SjzhFpgoCbEiJ8CvTKSW7h06n0nsOmG5mstnOMim3MQgniCVKL4DRw3aCDEIfQHWgVFNx8Lzuv6tIw=="}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:07.825843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-115936ca-a91e-44a5-92bb-8d47ef2e1168 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:33:07.831781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-115936ca-a91e-44a5-92bb-8d47ef2e1168 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:33:07.859945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-115936ca-a91e-44a5-92bb-8d47ef2e1168 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053962 May 09 20:33:07.861094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 390/739] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:33:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:09.220851 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1143344841", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faed6f7c-f550-49ae-a092-e26879c69bec"}], "security_groups": [{"name": "tempest-securitygroup--837238334"}], "key_name": "tempest-keypair-1586583854", "user_data": "}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:09.328386 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] validate_networks() for [('faed6f7c-f550-49ae-a092-e26879c69bec', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:33:09.442142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:09.443348 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:09.450139 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:09.450584 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:09.451555 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:09.452670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:09.480001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lazy-loading 'flavor' on Instance uuid eeee17c4-5609-4625-accc-1b95b2010b31 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:33:09.714575 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:33:09.714993 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:33:09.715536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:33:09.716132 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:33:09.716539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:33:09.725895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:09.726368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:09.727234 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:09.727891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:09.746557 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:33:09.751272 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Getting quotas for user dee809a4a41f4d2c91edb83c1f4d224c and project 5fe87375072b4dbbaac833caf2f705aa. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:33:09.762958 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:33:09.765792 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:33:09.774333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-500251e2-5c67-4986-9269-c313a7883f19 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/action" status: 202 len: 0 microversion: 2.20 time: 0.338139 May 09 20:33:09.775286 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 391/740] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 20:33:09 2022] POST /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 09 20:33:09.784397 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:09.785173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:09.792333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:09.792973 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:09.793896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:09.794417 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:09.824033 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5f22b3cb-e3ac-4ccd-b082-0c1f72f1bd45 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606466 May 09 20:33:09.824454 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 350/741] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:33:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:33:09.835737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6eaa897b-fc30-472c-9da3-4e80b434e5c5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:09.836693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6eaa897b-fc30-472c-9da3-4e80b434e5c5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:09.907499 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6eaa897b-fc30-472c-9da3-4e80b434e5c5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:09.914076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6eaa897b-fc30-472c-9da3-4e80b434e5c5 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1242 microversion: 2.1 time: 0.082642 May 09 20:33:09.915036 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 351/742] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:09 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:09.960527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:09.972774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:09.974406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:09.976201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-be5210ff-d898-43e5-b329-cf774bb4500c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.196633 May 09 20:33:09.976830 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 392/743] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:09 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:10.932028 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:10.933461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:10.943702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:10.944100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:10.944874 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:10.945303 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:10.996276 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:10.997000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:11.004913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:11.005475 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:11.006314 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:11.006815 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:11.145452 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:11.154564 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:11.157166 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:11.158563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e158eedc-6700-4d25-9de9-801be471c11d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.166203 May 09 20:33:11.159453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 393/744] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:10 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:11.278638 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:11.289517 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d080357e-9bad-4b9f-b97f-0fe1a533d86e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1300 microversion: 2.1 time: 0.361748 May 09 20:33:11.290371 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 352/745] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:10 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1300 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:12.179254 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:12.180082 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:12.187817 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:12.188265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:12.189311 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:12.189748 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:12.309287 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:12.311921 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:12.319831 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:12.320584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:12.321574 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:12.322192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:12.336926 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:12.345339 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:12.346965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:12.348427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b32bc56c-6ea3-433c-9cbe-eccb3dc67ebb tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.173384 May 09 20:33:12.360128 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 394/746] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:12 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:12.449208 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-c6c68d4e-b1f4-4f3a-9f69-1c55c117e938 req-5344553b-91a0-4a3a-9dcf-f13ea45a3924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "076708ed-794d-4b76-9ece-a8eb73bb3a67", "tag": "1466f16d-53c3-41b2-af75-c669563ff0bd"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:12.458202 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c6c68d4e-b1f4-4f3a-9f69-1c55c117e938 req-5344553b-91a0-4a3a-9dcf-f13ea45a3924 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:12.458848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c6c68d4e-b1f4-4f3a-9f69-1c55c117e938 req-5344553b-91a0-4a3a-9dcf-f13ea45a3924 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:12.489673 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-c6c68d4e-b1f4-4f3a-9f69-1c55c117e938 req-5344553b-91a0-4a3a-9dcf-f13ea45a3924 service nova] Creating event network-changed:1466f16d-53c3-41b2-af75-c669563ff0bd for instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 on hv-cinder-83699 May 09 20:33:12.495518 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-c6c68d4e-b1f4-4f3a-9f69-1c55c117e938 req-5344553b-91a0-4a3a-9dcf-f13ea45a3924 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050069 May 09 20:33:12.496200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 395/747] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:12.642325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:12.653169 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-49e8c519-0ec3-41cd-8149-d86d420f4f95 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.348819 May 09 20:33:12.653915 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 353/748] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:12 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:13.369438 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:13.370233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:13.377349 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:13.377930 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:13.378860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:13.379293 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:13.552095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:13.559738 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:13.561251 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:13.562654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b5eb1862-c42b-4831-b105-23302e9d9a4d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.198070 May 09 20:33:13.563211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 396/749] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:13 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:13.669889 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:13.670597 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:13.676911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:13.677425 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:13.678192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:13.678613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:13.806410 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:13.814094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4d06d2a6-8107-4c83-8365-e3b487ea51c4 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.148067 May 09 20:33:13.814646 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 354/750] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:13 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:14.581823 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:14.582433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:14.588494 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:14.588942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:14.589698 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:14.590253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:14.721714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:14.729533 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:14.731036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:14.732209 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f9c143a2-723f-45f9-8b02-404f32f0f52f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.154536 May 09 20:33:14.732762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 397/751] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:14 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:14.831096 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:14.832090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:14.838643 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:14.839091 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:14.839879 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:14.840312 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:14.970739 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:14.978301 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fb1266b8-9a2a-42fb-9026-c33662352935 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.152016 May 09 20:33:14.978865 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 355/752] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:14 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:15.750983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:15.751626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:15.757899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:15.758346 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:15.759104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:15.759566 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:15.891659 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:15.905405 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:15.906766 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:15.907999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b1a1623d-e25e-4335-982b-59daf4f3709e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.160872 May 09 20:33:15.908853 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 398/753] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:15 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:15.995662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:15.996284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:16.012906 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:16.013380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:16.014196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:16.014690 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:16.149910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:16.157696 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ef6992be-5a96-4cfc-95cd-2e7474225a75 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.165898 May 09 20:33:16.158254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 356/754] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:15 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:16.928418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:16.928973 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:16.936474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:16.937365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:16.938285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:16.938788 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:17.072831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:17.080690 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:17.082184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:17.083330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ae28606e-a8e2-45e1-8821-228d102af987 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.159148 May 09 20:33:17.083915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 399/755] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:16 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:17.174044 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:17.174687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:17.181082 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:17.181461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:17.182213 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:17.182638 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:17.312744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:17.320048 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-bc8d4e43-0306-4870-bdc7-2b630d9da2bd tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.149893 May 09 20:33:17.320617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 357/756] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:17 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:18.102739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:18.103347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:18.110765 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:18.111227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:18.112289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:18.112722 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:18.249861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:18.258019 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:18.259519 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:18.260926 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-83496ac5-2c9d-42b7-82ad-663679cb8dc5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.162688 May 09 20:33:18.261480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 400/757] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:18 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:18.336601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:18.337217 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:18.344333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:18.344779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:18.345620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:18.346056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:18.482283 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:18.490424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7286a4a4-eec1-451d-b7e8-11de6bf79ab1 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.157572 May 09 20:33:18.490937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 358/758] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:18 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:18.922493 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-6a9b87f7-697d-4633-b9b4-c86c177c23d2 req-50d0cbd5-4104-49c6-a96a-fdab5df40a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076708ed-794d-4b76-9ece-a8eb73bb3a67", "name": "network-vif-plugged", "status": "completed", "tag": "1466f16d-53c3-41b2-af75-c669563ff0bd"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:18.932217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-6a9b87f7-697d-4633-b9b4-c86c177c23d2 req-50d0cbd5-4104-49c6-a96a-fdab5df40a92 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:18.932656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-6a9b87f7-697d-4633-b9b4-c86c177c23d2 req-50d0cbd5-4104-49c6-a96a-fdab5df40a92 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:18.945153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-6a9b87f7-697d-4633-b9b4-c86c177c23d2 req-50d0cbd5-4104-49c6-a96a-fdab5df40a92 service nova] Creating event network-vif-plugged:1466f16d-53c3-41b2-af75-c669563ff0bd for instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 on hv-cinder-83699 May 09 20:33:18.950521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-6a9b87f7-697d-4633-b9b4-c86c177c23d2 req-50d0cbd5-4104-49c6-a96a-fdab5df40a92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031770 May 09 20:33:18.951311 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 401/759] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:19.278858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:19.279492 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:19.285434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:19.285938 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:19.286711 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:19.287143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:19.429159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:19.439212 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:19.440798 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:19.441988 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fe309df0-86ee-4c0a-83c4-cf985f892ad2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.167084 May 09 20:33:19.442526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 359/760] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:19 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:19.508063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:19.508927 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:19.516191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:19.517235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:19.518449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:19.519810 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:19.669831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:19.677300 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b25236e8-05a5-48cc-8209-d44fc7c1d301 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.173865 May 09 20:33:19.677871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 402/761] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:19 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:20.461727 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:20.462329 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:20.468693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:20.469129 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:20.469875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:20.470297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:20.599744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:20.607322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:20.609530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:20.610655 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8c50a842-4cae-430b-a020-06bea34e5a8d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.153455 May 09 20:33:20.611193 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 360/762] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:20 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:20.694344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:20.695158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:20.702075 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:20.702532 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:20.703270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:20.703728 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:20.830215 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:20.837399 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-63cd74d2-bfb1-4a69-83f8-4cbcf23ba2a8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1367 microversion: 2.1 time: 0.146898 May 09 20:33:20.837945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 403/763] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:20 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:21.005847 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1444451858", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "networks": [{"uuid": "2ef26078-d754-4bc0-8177-92e9e8bd2842"}]}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:21.053436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] validate_networks() for [('2ef26078-d754-4bc0-8177-92e9e8bd2842', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:33:21.387370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:33:21.387858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:33:21.388318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:33:21.388716 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:33:21.389117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:33:21.397606 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:21.398153 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:21.399039 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:21.399571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:21.417585 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Getting quotas for project 6cb3f86664bf42b5a26dabed328f6eae. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:33:21.421835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Getting quotas for user 41c6cd4289b542aaa6919acc0644d233 and project 6cb3f86664bf42b5a26dabed328f6eae. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:33:21.432522 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:33:21.434614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:33:21.481130 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8bcbb84f-08ab-4987-9ba0-7f696e81e5e0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.479039 May 09 20:33:21.481810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 361/764] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:33:21.492373 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1725e9d8-63ae-40c8-b136-49836c4f4432 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:21.493366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1725e9d8-63ae-40c8-b136-49836c4f4432 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:21.551193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1725e9d8-63ae-40c8-b136-49836c4f4432 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:21.557535 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1725e9d8-63ae-40c8-b136-49836c4f4432 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1214 microversion: 2.1 time: 0.068969 May 09 20:33:21.558164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 404/765] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:21 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:21.629102 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:21.629829 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:21.636186 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:21.636742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:21.637527 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:21.637954 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:21.775165 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:21.783763 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:21.785267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:21.786426 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1f596a57-4d18-4efd-924b-086f3933068a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1744 microversion: 2.20 time: 0.161501 May 09 20:33:21.786989 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 362/766] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:21 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:21.854904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:21.855713 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:21.863039 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:21.863512 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:21.864347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:21.864781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:22.008946 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:22.022435 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8410d3ef-46c6-494a-8f13-c1562918d08e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1556 microversion: 2.1 time: 0.171423 May 09 20:33:22.023047 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 405/767] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:21 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:22.043840 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-23da1066-1b42-462a-b2d8-072d53d01712 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:22.043840 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-23da1066-1b42-462a-b2d8-072d53d01712 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:22.045795 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23da1066-1b42-462a-b2d8-072d53d01712 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:22.046426 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23da1066-1b42-462a-b2d8-072d53d01712 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:22.047305 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23da1066-1b42-462a-b2d8-072d53d01712 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:22.047768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-23da1066-1b42-462a-b2d8-072d53d01712 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:22.128293 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-23da1066-1b42-462a-b2d8-072d53d01712 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092926 May 09 20:33:22.128891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 363/768] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 20:33:22 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:33:22.580561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:22.581201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:22.588032 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:22.588480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:22.589262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:22.589697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:22.659626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:22.667631 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-76f3362a-e34a-4b72-96af-bce217a3974d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1274 microversion: 2.1 time: 0.095288 May 09 20:33:22.668543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 406/769] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:22 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:22.804897 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:22.805536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:22.811511 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:22.812309 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:22.813076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:22.813506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:23.082285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:23.089968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:23.091489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:23.092782 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8cb0746b-44ae-4a51-acdb-fd2ecccc7c6e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1744 microversion: 2.20 time: 0.292293 May 09 20:33:23.094050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 364/770] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:22 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1744 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:23.688225 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:23.689789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:23.695831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:23.696338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:23.697115 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:23.697553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:23.763078 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:23.772548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-87d31768-2827-4acc-ad99-fd0399287f38 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1272 microversion: 2.1 time: 0.090237 May 09 20:33:23.782796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 407/771] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:23 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:23.783638 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-807f018d-038f-468a-b828-ee4eec824b29 req-9e2bac31-8e8c-4330-9808-a5483862d914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "076708ed-794d-4b76-9ece-a8eb73bb3a67", "tag": "1466f16d-53c3-41b2-af75-c669563ff0bd"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:23.794872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-807f018d-038f-468a-b828-ee4eec824b29 req-9e2bac31-8e8c-4330-9808-a5483862d914 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:23.795614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-807f018d-038f-468a-b828-ee4eec824b29 req-9e2bac31-8e8c-4330-9808-a5483862d914 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:23.808039 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-807f018d-038f-468a-b828-ee4eec824b29 req-9e2bac31-8e8c-4330-9808-a5483862d914 service nova] Creating event network-changed:1466f16d-53c3-41b2-af75-c669563ff0bd for instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 on hv-cinder-83699 May 09 20:33:23.814836 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-807f018d-038f-468a-b828-ee4eec824b29 req-9e2bac31-8e8c-4330-9808-a5483862d914 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038156 May 09 20:33:23.815772 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 365/772] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:33:24.112084 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:24.114046 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:24.118963 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:24.119455 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:24.120241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:24.120676 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:24.265939 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:24.273725 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:24.275213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:24.276406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fe3608e7-60f1-4441-bb24-1cc1610f9741 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1744 microversion: 2.20 time: 0.168359 May 09 20:33:24.277199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 408/773] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:24 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:24.792140 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:24.793117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:24.801050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:24.801495 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:24.802566 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:24.802992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:25.001034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:25.010289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-75b8c030-5a32-4b3d-b409-7d5507dcfd47 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.223370 May 09 20:33:25.011289 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 366/774] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:24 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:25.294051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:25.294756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:25.301999 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:25.302746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:25.303719 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:25.304315 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:25.437748 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:25.445761 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:25.447250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:25.448429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a67028f3-6b96-4fd5-b130-ade6cb2f42fa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1744 microversion: 2.20 time: 0.158334 May 09 20:33:25.448986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 409/775] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:25 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:25.829939 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-f7532ed1-acb3-4ceb-a5b7-62ef340896aa req-f254f091-f4e3-4f79-99eb-2a21a966038b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c278af-99f7-445b-8f96-36f5650d1189", "tag": "d429668d-e85b-4540-8c3d-6ca9a8060eb0"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:25.838141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-f7532ed1-acb3-4ceb-a5b7-62ef340896aa req-f254f091-f4e3-4f79-99eb-2a21a966038b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:25.838576 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-f7532ed1-acb3-4ceb-a5b7-62ef340896aa req-f254f091-f4e3-4f79-99eb-2a21a966038b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:25.849609 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-f7532ed1-acb3-4ceb-a5b7-62ef340896aa req-f254f091-f4e3-4f79-99eb-2a21a966038b service nova] Creating event network-changed:d429668d-e85b-4540-8c3d-6ca9a8060eb0 for instance f6c278af-99f7-445b-8f96-36f5650d1189 on hv-cinder-83699 May 09 20:33:25.854765 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-f7532ed1-acb3-4ceb-a5b7-62ef340896aa req-f254f091-f4e3-4f79-99eb-2a21a966038b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028529 May 09 20:33:25.855330 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 367/776] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:26.027493 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:26.028029 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:26.034623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:26.035076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:26.035865 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:26.036311 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:26.163351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:26.170639 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e84b1cd8-59be-4b0c-93d6-47dbc0ebbbca tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.147056 May 09 20:33:26.171250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 410/777] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:26 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:26.468748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:26.470029 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:26.476256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:26.476700 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:26.477464 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:26.477893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:26.623667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:26.631230 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:26.632771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:26.633910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-198594c2-8367-4817-96fb-7ec28c057c73 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1744 microversion: 2.20 time: 0.170515 May 09 20:33:26.634466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 368/778] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:26 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:26.961216 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-8bb5ed03-426a-4b03-b1e5-9db35aa6f452 req-bda2be64-20bb-412c-a862-e148e03107cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeee17c4-5609-4625-accc-1b95b2010b31", "name": "network-vif-plugged", "status": "completed", "tag": "96f29356-267d-448b-b032-8d87f2262256"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:26.970539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-8bb5ed03-426a-4b03-b1e5-9db35aa6f452 req-bda2be64-20bb-412c-a862-e148e03107cc service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:26.971191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-8bb5ed03-426a-4b03-b1e5-9db35aa6f452 req-bda2be64-20bb-412c-a862-e148e03107cc service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:26.982583 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-8bb5ed03-426a-4b03-b1e5-9db35aa6f452 req-bda2be64-20bb-412c-a862-e148e03107cc service nova] Creating event network-vif-plugged:96f29356-267d-448b-b032-8d87f2262256 for instance eeee17c4-5609-4625-accc-1b95b2010b31 on hv-cinder-83699 May 09 20:33:26.988135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-8bb5ed03-426a-4b03-b1e5-9db35aa6f452 req-bda2be64-20bb-412c-a862-e148e03107cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 May 09 20:33:26.988731 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 411/779] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:27.188055 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:27.188601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:27.195001 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:27.195481 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:27.196247 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:27.196683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:27.320809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:27.328680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c93696ad-251f-4259-b317-3685db3f6556 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.144940 May 09 20:33:27.329335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 369/780] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:27 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:27.652899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:27.653588 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:27.660372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:27.660811 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:27.661558 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:27.661985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:27.791577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:27.799509 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:27.800978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:27.802109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d6fd76f3-b83e-4ec9-9221-e0d57a7db1c7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1744 microversion: 2.20 time: 0.153464 May 09 20:33:27.802658 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 412/781] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:27 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:28.346086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:28.346783 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:28.353102 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:28.353549 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:28.354313 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:28.354747 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:28.573832 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:28.581196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7bba266a-e2a8-428b-97bd-dd7c00c06b02 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.239446 May 09 20:33:28.590412 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 370/782] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:28 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:28.820686 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:28.821298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:28.827765 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:28.828143 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:28.828905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:28.829343 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:28.955192 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:28.965195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:28.966729 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:28.968688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-de099fce-6465-4d72-ad5e-d8bee20f21e5 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1744 microversion: 2.20 time: 0.151197 May 09 20:33:28.969346 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 413/783] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:28 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:29.597957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:29.598643 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:29.605513 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:29.605961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:29.606765 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:29.607196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:29.753860 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:29.761904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b96c9d39-7412-4506-848c-da6ec9d89607 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.167565 May 09 20:33:29.762726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 371/784] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:29 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:29.989444 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:29.990647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:29.997328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:29.997771 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:29.998532 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:29.999876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:30.156945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:30.167506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:30.169239 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:30.170386 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-dd8b42d8-b332-4c96-966d-5f97f400e0f7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.186939 May 09 20:33:30.175259 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 414/785] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:29 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:30.778861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:30.781044 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:30.788871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:30.789635 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:30.790542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:30.790974 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:30.944996 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:30.953421 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6e8700a4-a57f-4afd-8bc6-9978477b878a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.178308 May 09 20:33:30.954150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 372/786] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:30 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:31.190681 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:31.191220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:31.197827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:31.198507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:31.199507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:31.199911 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:31.334653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:31.342661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:31.345035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:31.346185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-df452d9d-9813-426f-bda4-2f5345929ada tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.159988 May 09 20:33:31.346943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 415/787] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:31 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:31.970630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:31.971232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:31.978402 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:31.979024 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:31.979827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:31.980260 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:32.119897 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:32.130853 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-35f393b7-43c7-4009-bfb5-bab1f25c96c0 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.164736 May 09 20:33:32.131440 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 373/788] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:31 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:32.365170 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:32.365831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:32.372627 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:32.373080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:32.373905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:32.374324 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:32.511103 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:32.520109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:32.521646 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:32.523258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4c9dda6e-3ddf-4459-b2fb-4c5bceec0f3e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.162102 May 09 20:33:32.523948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 416/789] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:32 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:33.038695 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-37147857-13fe-4133-9fbc-ef4d43abc72c req-b44d89b1-6e4c-4568-ac5b-8a107aa78e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c278af-99f7-445b-8f96-36f5650d1189", "name": "network-vif-plugged", "status": "completed", "tag": "d429668d-e85b-4540-8c3d-6ca9a8060eb0"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:33.050746 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-37147857-13fe-4133-9fbc-ef4d43abc72c req-b44d89b1-6e4c-4568-ac5b-8a107aa78e99 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:33.051679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-37147857-13fe-4133-9fbc-ef4d43abc72c req-b44d89b1-6e4c-4568-ac5b-8a107aa78e99 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:33.064848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-37147857-13fe-4133-9fbc-ef4d43abc72c req-b44d89b1-6e4c-4568-ac5b-8a107aa78e99 service nova] Creating event network-vif-plugged:d429668d-e85b-4540-8c3d-6ca9a8060eb0 for instance f6c278af-99f7-445b-8f96-36f5650d1189 on hv-cinder-83699 May 09 20:33:33.069889 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-37147857-13fe-4133-9fbc-ef4d43abc72c req-b44d89b1-6e4c-4568-ac5b-8a107aa78e99 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035275 May 09 20:33:33.070996 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 374/790] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:33.150164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:33.151132 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:33.158850 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:33.159655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:33.160521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:33.161064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:33.321280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:33.332030 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0ea9f36e-8942-4cd6-b568-e412eee9a363 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.186393 May 09 20:33:33.332755 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 417/791] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:33 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:33.542812 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:33.543587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:33.550250 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:33.550759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:33.551588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:33.552047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:33.693059 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:33.701258 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:33.703564 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:33.704919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fcf7e6ea-9baa-4b4d-9440-aa4daf9ace3c tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.166538 May 09 20:33:33.705642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 375/792] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:33 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:34.352890 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:34.353512 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:34.362228 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:34.363285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:34.364212 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:34.364652 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:34.536959 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:34.545518 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a124f072-44a1-4b69-928f-b0f7f1c87d33 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1314 microversion: 2.1 time: 0.199145 May 09 20:33:34.551059 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 418/793] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:34 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:34.725520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:34.726862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:34.735301 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:34.736001 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:34.736950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:34.737572 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:34.951094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:34.963291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:34.965053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:34.966336 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2ae63e59-7e79-4e48-aef2-278c247e41ef tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.244878 May 09 20:33:34.967013 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 376/794] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:34 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:35.567364 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:35.569483 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:35.577461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:35.578437 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:35.579644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:35.580597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:35.767747 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:35.775576 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5b2ce6e1-5bc8-4614-b89b-89beb1632783 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1498 microversion: 2.1 time: 0.213263 May 09 20:33:35.776174 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 419/795] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:35 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1498 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:35.987284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:35.988877 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:35.996402 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:35.997687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:35.998469 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:36.000200 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:36.206368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:36.215830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:36.219742 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:36.221002 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-481e015a-c7d8-4f43-8613-15476949983a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.239069 May 09 20:33:36.221738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 377/796] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:35 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:36.339452 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:36.340194 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:36.347246 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:36.348108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:36.349051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:36.349513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:36.381315 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:33:36.469392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-cf39af1b-5034-4af1-86ce-21a9e02ecb73 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 204 len: 0 microversion: 2.1 time: 0.133276 May 09 20:33:36.474576 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 420/797] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:33:36 2022] DELETE /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:33:36.486484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:36.488326 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:36.502524 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:36.502974 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:36.503787 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:36.504222 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:36.650906 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:36.660764 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4f871ce3-c506-487c-90c9-51df5f779bc3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1504 microversion: 2.1 time: 0.185562 May 09 20:33:36.661968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 378/798] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:36 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:37.240704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:37.242036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:37.251559 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:37.252230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:37.252997 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:37.253427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:37.407290 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:37.416718 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:37.418702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:37.419970 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b938f717-d384-442b-859e-03849b39ac5f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.183488 May 09 20:33:37.421122 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 421/799] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:37 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:37.677938 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:37.678565 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:37.685156 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:37.685597 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:37.687184 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:37.687628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:37.860516 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:37.869360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c86f6829-76c5-4815-9f99-86d7142ceaac tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1504 microversion: 2.1 time: 0.195088 May 09 20:33:37.871641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 379/800] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:37 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:38.438981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:38.439672 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:38.454193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:38.454910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:38.455712 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:38.456322 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:38.657937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:38.666247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:38.667746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:38.669053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8ed2ea1b-0fd2-4f95-9584-cc13ed82cbc6 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.234997 May 09 20:33:38.669994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 422/801] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:38 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:38.886307 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:38.887545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:38.897831 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:38.898518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:38.899507 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:38.900126 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:38.992542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:39.003136 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-43eeebc4-2f30-425d-be2b-28aa03c19570 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 200 len: 1462 microversion: 2.1 time: 0.120858 May 09 20:33:39.004343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 380/802] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:38 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 1462 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:39.006973 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-862d3d96-b8c1-4b41-963e-4f9c2caa43a4 req-ecc1a321-ed68-4bcd-b3e5-9887b76cadf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c278af-99f7-445b-8f96-36f5650d1189", "name": "network-vif-deleted", "tag": "d429668d-e85b-4540-8c3d-6ca9a8060eb0"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:39.016696 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-862d3d96-b8c1-4b41-963e-4f9c2caa43a4 req-ecc1a321-ed68-4bcd-b3e5-9887b76cadf0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:39.017386 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-862d3d96-b8c1-4b41-963e-4f9c2caa43a4 req-ecc1a321-ed68-4bcd-b3e5-9887b76cadf0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:39.029514 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-862d3d96-b8c1-4b41-963e-4f9c2caa43a4 req-ecc1a321-ed68-4bcd-b3e5-9887b76cadf0 service nova] Creating event network-vif-deleted:d429668d-e85b-4540-8c3d-6ca9a8060eb0 for instance f6c278af-99f7-445b-8f96-36f5650d1189 on hv-cinder-83699 May 09 20:33:39.039562 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-862d3d96-b8c1-4b41-963e-4f9c2caa43a4 req-ecc1a321-ed68-4bcd-b3e5-9887b76cadf0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035856 May 09 20:33:39.040363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 423/803] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:33:39.688133 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:39.688757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:39.695270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:39.695802 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:39.696635 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:39.697072 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:39.824282 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:39.832170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:39.833659 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:39.834805 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-89ae937d-2ec8-4e58-914b-0bfff73f3a5b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1739 microversion: 2.20 time: 0.151420 May 09 20:33:39.835363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 381/804] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:39 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:40.020897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:40.021614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: f6c278af-99f7-445b-8f96-36f5650d1189] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:40.027701 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:40.028144 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:40.028891 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:40.029319 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:40.044574 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] HTTP exception thrown: Instance f6c278af-99f7-445b-8f96-36f5650d1189 could not be found. May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Request method failure captured: May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 HTTP/1.1 May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXqPyU_R0FU0vPaycWssXIfavpQGhes934HsU3FWHBwqvztSCVxL1ie1BmG8lgEWWwP2LG4tMS-qvsnQ_z-E3WdX21OhBPkog0y14MxuGLoHz8KdCTzEanggBYTZJSSZR2KmeVwBxSJVHnZqz1EoUPSR_jTgVGRY5PaZFwy9OJuLO3w May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 6cb3f86664bf42b5a26dabed328f6eae May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-VolumesActionsTest-36694844 May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:33:40.046861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6cb3f86664bf42b5a26dabed328f6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6cb3f86664bf42b5a26dabed328f6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6cb3f86664bf42b5a26dabed328f6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6cb3f86664bf42b5a26dabed328f6eae"}]}] May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-VolumesActionsTest-36694844 May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 6cb3f86664bf42b5a26dabed328f6eae May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-VolumesActionsTest-36694844 May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-VolumesActionsTest-36694844-project May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 41c6cd4289b542aaa6919acc0644d233 May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-VolumesActionsTest-36694844-project May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance f6c278af-99f7-445b-8f96-36f5650d1189 could not be found. May 09 20:33:40.048466 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': 'f6c278af-99f7-445b-8f96-36f5650d1189'} May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c278af-99f7-445b-8f96-36f5650d1189 could not be found. May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:33:40.049524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c278af-99f7-445b-8f96-36f5650d1189 could not be found. May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c278af-99f7-445b-8f96-36f5650d1189 could not be found. May 09 20:33:40.050998 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:33:40.052803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Returning 404 to user: Instance f6c278af-99f7-445b-8f96-36f5650d1189 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:33:40.052803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6b78e41c-facc-43ec-ae1c-b9219574f662 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189" status: 404 len: 111 microversion: 2.1 time: 0.031961 May 09 20:33:40.052803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 424/805] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:40 2022] GET /compute/v2.1/servers/f6c278af-99f7-445b-8f96-36f5650d1189 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:33:40.097581 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1898188718", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452", "networks": [{"uuid": "2ef26078-d754-4bc0-8177-92e9e8bd2842"}]}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:40.149306 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] validate_networks() for [('2ef26078-d754-4bc0-8177-92e9e8bd2842', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:33:40.489539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:33:40.489957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:33:40.490427 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:33:40.490830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:33:40.491236 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:33:40.502210 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:40.502656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:40.503476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:40.503912 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:40.521097 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Getting quotas for project 6cb3f86664bf42b5a26dabed328f6eae. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:33:40.524973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Getting quotas for user 41c6cd4289b542aaa6919acc0644d233 and project 6cb3f86664bf42b5a26dabed328f6eae. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:33:40.536481 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:33:40.538757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:33:40.583641 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-45a0dd18-a01c-4590-86ce-9ebfd5d9b50c tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489850 May 09 20:33:40.584601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 382/806] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:33:40.594755 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ef7d4063-d4d6-467d-9c5f-55eaaf330a45 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:40.595362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ef7d4063-d4d6-467d-9c5f-55eaaf330a45 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:40.650700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ef7d4063-d4d6-467d-9c5f-55eaaf330a45 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:40.657846 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ef7d4063-d4d6-467d-9c5f-55eaaf330a45 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1214 microversion: 2.1 time: 0.067371 May 09 20:33:40.667184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 425/807] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:40 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:40.853518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:40.854331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:40.860642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:40.861081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:40.861845 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:40.862271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:41.299178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:41.307041 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:41.308589 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:41.309752 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a8ae4b44-04c1-4505-9d37-d8cff9b8a69e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1721 microversion: 2.20 time: 0.460343 May 09 20:33:41.310311 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 383/808] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:40 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:41.675332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:41.675971 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:41.683020 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:41.683500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:41.684268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:41.684704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:41.744408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:41.751646 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d2b2c783-3d47-4331-a2b9-9df06ec31c70 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1272 microversion: 2.1 time: 0.080986 May 09 20:33:41.752222 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 426/809] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:41 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:42.329696 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:42.330303 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:42.336711 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:42.337151 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:42.337905 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:42.338335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:42.464661 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:42.472347 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:42.473840 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:42.474984 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b73f4e6a-2c78-43fa-9059-21dc84e69532 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1721 microversion: 2.20 time: 0.149464 May 09 20:33:42.475581 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 384/810] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:42 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:42.768769 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:42.769398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:42.775714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:42.776158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:42.776913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:42.777342 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:42.837015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:42.844193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-847ab297-1fd9-4472-8422-fdd1401d9f07 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1272 microversion: 2.1 time: 0.079505 May 09 20:33:42.844752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 427/811] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:42 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1272 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:42.987830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-8b6684bd-29d3-4206-bb10-98ea4a2c38bd req-139b75c5-1521-4126-89cb-e603c68bf5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeee17c4-5609-4625-accc-1b95b2010b31", "name": "network-vif-unplugged", "status": "completed", "tag": "96f29356-267d-448b-b032-8d87f2262256"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:42.995852 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-8b6684bd-29d3-4206-bb10-98ea4a2c38bd req-139b75c5-1521-4126-89cb-e603c68bf5aa service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:42.996295 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-8b6684bd-29d3-4206-bb10-98ea4a2c38bd req-139b75c5-1521-4126-89cb-e603c68bf5aa service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:43.007490 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-8b6684bd-29d3-4206-bb10-98ea4a2c38bd req-139b75c5-1521-4126-89cb-e603c68bf5aa service nova] Creating event network-vif-unplugged:96f29356-267d-448b-b032-8d87f2262256 for instance eeee17c4-5609-4625-accc-1b95b2010b31 on hv-cinder-83699 May 09 20:33:43.012720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-8b6684bd-29d3-4206-bb10-98ea4a2c38bd req-139b75c5-1521-4126-89cb-e603c68bf5aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029239 May 09 20:33:43.013310 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 385/812] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:43.493229 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:43.493959 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:43.499908 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:43.500440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:43.501278 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:43.501720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:43.639961 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:43.648404 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:43.650041 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:43.651283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e8a7edb5-5ab9-443b-905a-2542ff5a064e tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1724 microversion: 2.20 time: 0.162000 May 09 20:33:43.651978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 428/813] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:43 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:43.672303 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6791595f-4c10-4fd2-a506-0d0c8a76bacf tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d338f6e-0373-4e2d-b833-79249bac7627"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:43.673453 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6791595f-4c10-4fd2-a506-0d0c8a76bacf tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:43.679986 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6791595f-4c10-4fd2-a506-0d0c8a76bacf tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:43.680588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6791595f-4c10-4fd2-a506-0d0c8a76bacf tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:43.681465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6791595f-4c10-4fd2-a506-0d0c8a76bacf tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:43.681851 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6791595f-4c10-4fd2-a506-0d0c8a76bacf tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:43.862066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:43.862806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:43.869806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:43.870346 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:43.871271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:43.871838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:43.961710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6791595f-4c10-4fd2-a506-0d0c8a76bacf tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294470 May 09 20:33:43.962936 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 386/814] 10.222.0.44 () {62 vars in 1363 bytes} [Mon May 9 20:33:43 2022] POST /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 20:33:44.017746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:44.025160 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-57a0d9cb-8362-4368-832f-806bbf4d76fb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.168074 May 09 20:33:44.025950 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 429/815] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:43 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:44.086716 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-bd65b798-40c3-412b-9007-82d1f653f828 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:44.087295 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-bd65b798-40c3-412b-9007-82d1f653f828 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:44.093410 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd65b798-40c3-412b-9007-82d1f653f828 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:44.094055 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd65b798-40c3-412b-9007-82d1f653f828 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:44.094810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd65b798-40c3-412b-9007-82d1f653f828 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:44.095237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-bd65b798-40c3-412b-9007-82d1f653f828 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:44.322909 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-bd65b798-40c3-412b-9007-82d1f653f828 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-volume_attachments/3d338f6e-0373-4e2d-b833-79249bac7627" status: 202 len: 0 microversion: 2.20 time: 0.240988 May 09 20:33:44.323751 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 387/816] 10.222.0.44 () {60 vars in 1456 bytes} [Mon May 9 20:33:44 2022] DELETE /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-volume_attachments/3d338f6e-0373-4e2d-b833-79249bac7627 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 20:33:44.336899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-ea4930cc-bdac-490b-8c79-b142267e7cd0 req-0a1af3da-8562-4964-a693-40fc7ff5f8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61857b6-d851-4b88-bd98-b6f0c643c590", "tag": "67d3da07-d963-44a9-a170-362b8a1f1c87"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:44.346767 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-ea4930cc-bdac-490b-8c79-b142267e7cd0 req-0a1af3da-8562-4964-a693-40fc7ff5f8ae service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:44.347207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-ea4930cc-bdac-490b-8c79-b142267e7cd0 req-0a1af3da-8562-4964-a693-40fc7ff5f8ae service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:44.361457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-ea4930cc-bdac-490b-8c79-b142267e7cd0 req-0a1af3da-8562-4964-a693-40fc7ff5f8ae service nova] Creating event network-changed:67d3da07-d963-44a9-a170-362b8a1f1c87 for instance b61857b6-d851-4b88-bd98-b6f0c643c590 on hv-cinder-83699 May 09 20:33:44.368026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-ea4930cc-bdac-490b-8c79-b142267e7cd0 req-0a1af3da-8562-4964-a693-40fc7ff5f8ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034823 May 09 20:33:44.368624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 430/817] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:44.390197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-eaa9df7b-0220-4d3f-96db-eb0840c7f408 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:44.390944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-eaa9df7b-0220-4d3f-96db-eb0840c7f408 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:44.396755 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eaa9df7b-0220-4d3f-96db-eb0840c7f408 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:44.397191 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eaa9df7b-0220-4d3f-96db-eb0840c7f408 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:44.397945 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eaa9df7b-0220-4d3f-96db-eb0840c7f408 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:44.398373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eaa9df7b-0220-4d3f-96db-eb0840c7f408 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:44.492826 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-eaa9df7b-0220-4d3f-96db-eb0840c7f408 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "POST /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/action" status: 202 len: 0 microversion: 2.20 time: 0.107393 May 09 20:33:44.495608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 388/818] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 20:33:44 2022] POST /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 20:33:44.504074 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:44.504868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:44.511187 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:44.511654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:44.512428 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:44.512988 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:44.669995 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:44.678582 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:44.680115 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:44.681331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b75fb2d3-0c9f-4a1e-a36d-3463de6cdfd1 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1672 microversion: 2.20 time: 0.183306 May 09 20:33:44.681880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 431/819] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:44 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:45.042282 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:45.042903 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:45.049505 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:45.049953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:45.050710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:45.051145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:45.215025 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:45.225806 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4ff78112-7a8a-48ad-97e2-338bc9d016cf tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.187729 May 09 20:33:45.226448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 389/820] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:45 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:45.700734 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:45.701366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:45.708236 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:45.708684 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:45.709441 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:45.709877 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:45.835919 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:45.844323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:45.845803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:45.847035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d11164b1-97bc-416b-a97e-0b28e12bae95 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1672 microversion: 2.20 time: 0.150097 May 09 20:33:45.847668 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 432/821] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:45 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:46.244037 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:46.244647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:46.251703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:46.252174 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:46.252929 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:46.253354 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:46.395770 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:46.403087 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a7f58b70-aaf3-49bd-8409-82570e305a9d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.162887 May 09 20:33:46.403682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 390/822] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:46 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:46.865695 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:46.866295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:46.872733 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:46.873176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:46.874210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:46.874642 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:47.010328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:47.018622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:47.020166 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:47.021336 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2a7842f4-a153-418e-998c-f2b6decb3f1b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1672 microversion: 2.20 time: 0.159750 May 09 20:33:47.021899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 433/823] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:46 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:47.420058 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:47.420837 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:47.427131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:47.427619 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:47.428385 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:47.428820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:47.684662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:47.692628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4a094fc9-c7ff-48c0-bb00-23dfc95be2c3 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.276428 May 09 20:33:47.702512 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 391/824] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:47 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:48.040097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:48.040700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:48.048011 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:48.048473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:48.049221 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:48.049654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:48.144002 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e45b67b7-a39c-4c3d-b28f-a537dc9fe3fb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:48.144729 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e45b67b7-a39c-4c3d-b28f-a537dc9fe3fb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:48.150611 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e45b67b7-a39c-4c3d-b28f-a537dc9fe3fb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:48.151195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e45b67b7-a39c-4c3d-b28f-a537dc9fe3fb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:48.152084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e45b67b7-a39c-4c3d-b28f-a537dc9fe3fb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:48.152666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e45b67b7-a39c-4c3d-b28f-a537dc9fe3fb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:48.178353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e45b67b7-a39c-4c3d-b28f-a537dc9fe3fb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/ips" status: 200 len: 144 microversion: 2.1 time: 0.038450 May 09 20:33:48.179113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 392/825] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:33:48 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:33:48.183044 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:48.191994 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:48.193496 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:48.194805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ffdab56a-acae-44b2-9cbc-06efe4f31ed7 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.158431 May 09 20:33:48.200488 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 434/826] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:48 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:48.709995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:48.710614 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:48.717709 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:48.718566 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:48.719015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:48.719839 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:48.871843 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:48.879672 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ed1b9413-a852-49e0-9b1c-c79ad46518a7 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.173274 May 09 20:33:48.880431 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 393/827] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:48 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:49.213358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:49.213981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:49.221461 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:49.221906 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:49.222683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:49.223116 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:49.373895 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:49.381692 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:49.383173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:49.384366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2efe5869-b729-41a5-88bf-af2fba804539 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.174916 May 09 20:33:49.384946 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 435/828] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:49 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:49.501240 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-677f3f3e-d76e-4538-886f-320c41e00945 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79ee25c8-c175-4301-9363-9f5229a62bfe"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:49.503044 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-677f3f3e-d76e-4538-886f-320c41e00945 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:49.510964 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-677f3f3e-d76e-4538-886f-320c41e00945 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:49.511423 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-677f3f3e-d76e-4538-886f-320c41e00945 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:49.512202 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-677f3f3e-d76e-4538-886f-320c41e00945 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:49.512631 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-677f3f3e-d76e-4538-886f-320c41e00945 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:49.897897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:49.898644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:49.905690 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:49.906227 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:49.907193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:49.907873 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:50.050561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:50.058276 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2b1e90e9-7963-4518-8682-080b87285403 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.164396 May 09 20:33:50.059473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 436/829] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:49 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:50.403055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:50.403931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:50.411100 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:50.411576 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:50.412351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:50.412779 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:50.550853 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:50.558957 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:50.560471 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:50.561648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c453b0c0-73ff-47fd-ae96-266c4cc98cc3 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.162596 May 09 20:33:50.562207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 437/830] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:50 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:51.076510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:51.077594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:51.084220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:51.084665 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:51.085697 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:51.086261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:51.233651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:51.242754 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-47e37ca9-b16d-414d-bce2-03c57a035756 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.171307 May 09 20:33:51.243345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 438/831] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:51 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:51.247768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-c745ffc1-c323-48c8-b7bd-38ab4f125e7f req-4703d9b7-89fa-4f66-9b18-3edaee3bc279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61857b6-d851-4b88-bd98-b6f0c643c590", "name": "network-vif-plugged", "status": "completed", "tag": "67d3da07-d963-44a9-a170-362b8a1f1c87"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:33:51.256104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c745ffc1-c323-48c8-b7bd-38ab4f125e7f req-4703d9b7-89fa-4f66-9b18-3edaee3bc279 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:51.256546 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c745ffc1-c323-48c8-b7bd-38ab4f125e7f req-4703d9b7-89fa-4f66-9b18-3edaee3bc279 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:51.268560 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-c745ffc1-c323-48c8-b7bd-38ab4f125e7f req-4703d9b7-89fa-4f66-9b18-3edaee3bc279 service nova] Creating event network-vif-plugged:67d3da07-d963-44a9-a170-362b8a1f1c87 for instance b61857b6-d851-4b88-bd98-b6f0c643c590 on hv-cinder-83699 May 09 20:33:51.273406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-c745ffc1-c323-48c8-b7bd-38ab4f125e7f req-4703d9b7-89fa-4f66-9b18-3edaee3bc279 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028912 May 09 20:33:51.274304 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 439/832] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:33:51.582295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:51.584214 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:51.590803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:51.591237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:51.592035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:51.597420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:51.735111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:51.743068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:51.744560 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:51.745711 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-02f76f88-246c-4c18-b03f-ec35d093e9a2 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.168135 May 09 20:33:51.746274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 440/833] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:51 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:52.260094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:52.261068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:52.267980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:52.268716 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:52.269559 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:52.270065 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:52.404774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:52.414108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-af67a14b-d3eb-497e-a7c7-a034fcd0677a tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.157839 May 09 20:33:52.417326 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 441/834] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:52 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:52.764591 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:52.765347 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:52.772476 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:52.772918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:52.773682 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:52.774112 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:52.936959 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:52.951638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:52.953135 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:52.954556 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c7f0f19f-a4fd-472c-a09b-5818d4a48787 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.194087 May 09 20:33:52.955947 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 442/835] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:52 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:53.431824 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:53.432439 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:53.439131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:53.439702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:53.440482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:53.440909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:53.585097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:53.592890 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-38d1b17b-3f16-40c3-9f45-a330e3b2edbb tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.164840 May 09 20:33:53.593458 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 443/836] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:53 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:33:53.974505 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:53.975490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:53.982053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:53.982573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:53.983349 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:53.983889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:54.124581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:54.133538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:54.135031 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:54.136475 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8991dd11-c08c-40f4-a4d0-d61220b2e235 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.166711 May 09 20:33:54.137033 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 444/837] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:53 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:54.610094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:54.611195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:54.617073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:54.617511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:54.618257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:54.618683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:54.749679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:54.758288 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-904a49a0-ef0d-4ad2-9d7a-c9cfc8e29e24 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.151882 May 09 20:33:54.758874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 445/838] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:54 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:55.157687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:55.158827 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:55.165661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:55.166105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:55.166869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:55.167298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:55.301648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:55.309909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:55.311375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:55.312568 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5e401065-0d15-4a91-b068-df39b99f2e6f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.161111 May 09 20:33:55.313112 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 446/839] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:55 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:33:55.776822 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:55.777483 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:55.783446 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:55.783888 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:55.784634 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:55.785063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:55.922226 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:55.929719 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6070a216-703f-444c-9d34-63e3f602c789 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.156691 May 09 20:33:55.930272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 447/840] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:55 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:56.333837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:56.334683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:56.347536 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:56.347985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:56.348761 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:56.349191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:56.483640 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:56.491667 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:56.493149 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:56.494298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7bd6d3b2-e192-488a-b941-06ecc1de4c4b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.166180 May 09 20:33:56.494855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 448/841] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:56 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:56.948523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:56.949139 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:56.955487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:56.956001 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:56.956788 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:56.957221 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:57.103217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:57.111187 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-73dbbaf3-e0d3-4d0a-bcd2-6e28f9659676 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.166457 May 09 20:33:57.111974 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 449/842] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:56 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:57.514325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:57.515126 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:57.522095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:57.522542 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:57.523341 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:57.523793 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:57.659142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:57.667598 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:57.669093 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:57.670258 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2dda3055-8a6a-491c-83d9-4bc33bb891b4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.160454 May 09 20:33:57.671037 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 450/843] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:57 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:58.128620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:58.129356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:58.135666 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:58.136123 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:58.136957 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:58.137393 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:58.308069 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:58.316128 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-abc461a2-bfdb-440c-b531-6151fabf66fd tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.191809 May 09 20:33:58.316622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 451/844] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:58 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:58.689548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:58.690166 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:58.696363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:58.696807 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:58.697554 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:58.697979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:58.827774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:58.836265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:58.837667 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:58.838804 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4cb72635-c6b9-42b1-b29e-48ed79c5d133 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.153884 May 09 20:33:58.839351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 452/845] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:58 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:33:59.332671 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:59.333282 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:59.339176 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:59.339648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:59.340397 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:59.340831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:59.465868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:33:59.473263 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-89c64f02-440b-430d-9201-ac88eeeac072 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.145004 May 09 20:33:59.473811 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 453/846] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:33:59 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:33:59.857140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:33:59.857752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:33:59.864250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:59.864693 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:59.865445 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:33:59.865876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:33:59.994538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:00.002323 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:00.003836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:00.004979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-22977c9c-8505-4ff0-8e90-8382ada5676a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.151764 May 09 20:34:00.005539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 454/847] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:33:59 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:34:00.489912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:00.490546 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:00.496516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:00.496958 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:00.497707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:00.498134 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:00.637569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:00.644926 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1f1f3f80-7be6-47db-a50b-84aae46d4cd4 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.158822 May 09 20:34:00.645483 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 455/848] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:00 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:34:01.023437 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:01.024096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:01.030267 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:01.030706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:01.031478 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:01.031905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:01.160338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:01.167860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:01.169325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:01.170459 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5580686a-178a-4e11-9c77-dc6a48af0841 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.150936 May 09 20:34:01.171012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 456/849] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:01 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:34:01.662219 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:01.662836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:01.668787 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:01.669242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:01.670003 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:01.670438 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:01.793931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:01.801420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4c85d8cf-0944-4ffb-864d-76cbc1148857 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.143022 May 09 20:34:01.801981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 457/850] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:01 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:34:02.190234 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:02.190915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:02.197270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:02.197717 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:02.198478 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:02.198910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:02.326249 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:02.334199 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:02.335751 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:02.336897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-bab2fa4a-e555-48bf-b74a-8224090404f0 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.151542 May 09 20:34:02.337457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 458/851] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:02 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:34:02.818039 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:02.818640 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:02.824550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:02.824986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:02.825732 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:02.826155 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:02.956162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:02.963251 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-30c0b82d-6dd1-4e5c-8f00-60c9b4f80dd2 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.149042 May 09 20:34:02.963838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 459/852] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:02 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:34:03.354509 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:03.355185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:03.361513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:03.361959 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:03.362718 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:03.363150 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:03.489562 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:03.497263 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:03.498744 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:03.499947 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0025d185-5f24-4c42-a440-3505837ed7f8 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.149321 May 09 20:34:03.500506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 460/853] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:03 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:34:03.980705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:03.981321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:03.987883 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:03.988334 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:03.989094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:03.989528 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:04.125741 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:04.134031 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-43ae209e-e6c5-4523-9d86-da1b8cd1cd93 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.157172 May 09 20:34:04.134814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 461/854] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:03 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:34:04.200657 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-677f3f3e-d76e-4538-886f-320c41e00945 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.705175 May 09 20:34:04.201269 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 394/855] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:33:49 2022] POST /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments => generated 194 bytes in 14707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:04.518197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:04.518806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:04.525068 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:04.525528 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:04.526282 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:04.526715 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:04.655286 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:04.663521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:04.665008 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:04.666149 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-285c777a-5633-4121-97cd-e0366f7fc6fe tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.152154 May 09 20:34:04.666704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 462/856] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:04 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:34:05.154715 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:05.155624 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:05.163730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:05.164181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:05.164952 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:05.165383 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:05.293302 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:05.300895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-51ff2656-e95c-479f-b45d-d87cfd8ef085 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1314 microversion: 2.1 time: 0.151995 May 09 20:34:05.301649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 395/857] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:05 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:34:05.684417 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:05.684962 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:05.692188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:05.692634 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:05.693403 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:05.693839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:05.821108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:05.829002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:05.830548 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:05.831732 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4bdd8dac-ce82-4f78-b37b-6ac150cbb598 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.151247 May 09 20:34:05.832284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 463/858] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:05 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:34:06.316953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:06.317578 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:06.323809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:06.324248 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:06.325005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:06.325432 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:06.455159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:06.462480 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b2968ca4-1e16-42e5-b3ac-3ceded500ef8 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1498 microversion: 2.1 time: 0.149511 May 09 20:34:06.463048 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 396/859] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:06 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:34:06.851073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:06.851723 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:06.858084 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:06.858529 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:06.859294 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:06.859875 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:06.875885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:06.876374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:06.883197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:06.883674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:06.884468 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:06.884895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:06.910357 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:34:07.000891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-58f3da6f-c014-4104-9bd9-04009cd2af2d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 204 len: 0 microversion: 2.1 time: 0.128441 May 09 20:34:07.003856 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 397/860] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:34:06 2022] DELETE /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 20:34:07.012710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:07.013557 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:07.015691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:07.020134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:07.020574 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:07.021330 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:07.021953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:07.025547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:07.027103 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:07.028506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-51098f79-8921-47b8-acc6-538007dacbdd tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.183613 May 09 20:34:07.029187 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 464/861] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:06 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:34:07.145632 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-160b3bb8-b4c1-4d55-918b-ff6b1e0cfab5 req-399a4de4-64e3-4991-a284-03cfd88442cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeee17c4-5609-4625-accc-1b95b2010b31", "name": "network-vif-plugged", "status": "completed", "tag": "96f29356-267d-448b-b032-8d87f2262256"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:34:07.154232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:07.159100 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-160b3bb8-b4c1-4d55-918b-ff6b1e0cfab5 req-399a4de4-64e3-4991-a284-03cfd88442cc service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:07.159688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-160b3bb8-b4c1-4d55-918b-ff6b1e0cfab5 req-399a4de4-64e3-4991-a284-03cfd88442cc service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:07.161932 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a4fa7ba9-711e-4c9b-8300-d6dc6b5a8ffa tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1504 microversion: 2.1 time: 0.153639 May 09 20:34:07.170807 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-160b3bb8-b4c1-4d55-918b-ff6b1e0cfab5 req-399a4de4-64e3-4991-a284-03cfd88442cc service nova] Creating event network-vif-plugged:96f29356-267d-448b-b032-8d87f2262256 for instance eeee17c4-5609-4625-accc-1b95b2010b31 on hv-cinder-83699 May 09 20:34:07.171957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 398/862] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:07 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:34:07.175938 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-160b3bb8-b4c1-4d55-918b-ff6b1e0cfab5 req-399a4de4-64e3-4991-a284-03cfd88442cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035150 May 09 20:34:07.176516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 465/863] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:34:08.046193 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:08.046770 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:08.054094 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:08.054534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:08.055295 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:08.056341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:08.180376 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:08.181086 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:08.187194 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:08.187661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:08.188429 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:08.188867 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:08.220224 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:08.229590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:08.231728 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:08.232505 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ca07ca62-9e64-4c5e-a4de-ebd66246807a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.190300 May 09 20:34:08.233076 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 399/864] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:08 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:34:08.319115 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:08.326418 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fa40946e-4915-4489-85f8-8197f9907816 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1504 microversion: 2.1 time: 0.150759 May 09 20:34:08.326983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 466/865] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:08 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:34:09.156747 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-921c8c37-e427-4b61-bd31-8f623c9661ee req-6c617a90-4ca6-4aea-a58d-95da758cc8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61857b6-d851-4b88-bd98-b6f0c643c590", "name": "network-vif-deleted", "tag": "67d3da07-d963-44a9-a170-362b8a1f1c87"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:34:09.166063 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-921c8c37-e427-4b61-bd31-8f623c9661ee req-6c617a90-4ca6-4aea-a58d-95da758cc8ca service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:09.166436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-921c8c37-e427-4b61-bd31-8f623c9661ee req-6c617a90-4ca6-4aea-a58d-95da758cc8ca service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:09.179798 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-921c8c37-e427-4b61-bd31-8f623c9661ee req-6c617a90-4ca6-4aea-a58d-95da758cc8ca service nova] Creating event network-vif-deleted:67d3da07-d963-44a9-a170-362b8a1f1c87 for instance b61857b6-d851-4b88-bd98-b6f0c643c590 on hv-cinder-83699 May 09 20:34:09.184638 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-921c8c37-e427-4b61-bd31-8f623c9661ee req-6c617a90-4ca6-4aea-a58d-95da758cc8ca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 May 09 20:34:09.185208 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 400/866] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:09.251308 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:09.251948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:09.258605 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:09.259049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:09.259834 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:09.260266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:09.345319 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:09.346188 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:09.355753 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:09.356538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:09.357442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:09.357880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:09.398901 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:09.406913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:09.409288 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:09.410783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-55378059-447b-4ae7-87a4-9bc9fb326090 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1730 microversion: 2.20 time: 0.163515 May 09 20:34:09.412047 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 467/867] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:09 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:34:09.426200 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c6cd4289b542aaa6919acc0644d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb3f86664bf42b5a26dabed328f6eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:09.433390 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-78d20839-39a4-41e3-89ff-0b2afb1e131d tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 200 len: 1462 microversion: 2.1 time: 0.092428 May 09 20:34:09.433950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 401/868] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:09 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:34:10.429390 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:10.429977 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:10.436400 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:10.436836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:10.437630 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:10.438058 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:10.451074 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:10.451774 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] [instance: b61857b6-d851-4b88-bd98-b6f0c643c590] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:10.458780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:10.459226 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:10.460019 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:10.460663 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:10.475938 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] HTTP exception thrown: Instance b61857b6-d851-4b88-bd98-b6f0c643c590 could not be found. May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Request method failure captured: May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 HTTP/1.1 May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXqPyU_R0FU0vPaycWssXIfavpQGhes934HsU3FWHBwqvztSCVxL1ie1BmG8lgEWWwP2LG4tMS-qvsnQ_z-E3WdX21OhBPkog0y14MxuGLoHz8KdCTzEanggBYTZJSSZR2KmeVwBxSJVHnZqz1EoUPSR_jTgVGRY5PaZFwy9OJuLO3w May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 6cb3f86664bf42b5a26dabed328f6eae May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesActionsTest-36694844 May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:34:10.477919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6cb3f86664bf42b5a26dabed328f6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6cb3f86664bf42b5a26dabed328f6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6cb3f86664bf42b5a26dabed328f6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6cb3f86664bf42b5a26dabed328f6eae"}]}] May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesActionsTest-36694844 May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 6cb3f86664bf42b5a26dabed328f6eae May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesActionsTest-36694844 May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesActionsTest-36694844-project May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 41c6cd4289b542aaa6919acc0644d233 May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesActionsTest-36694844-project May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance b61857b6-d851-4b88-bd98-b6f0c643c590 could not be found. May 09 20:34:10.479940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'b61857b6-d851-4b88-bd98-b6f0c643c590'} May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61857b6-d851-4b88-bd98-b6f0c643c590 could not be found. May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:10.480813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61857b6-d851-4b88-bd98-b6f0c643c590 could not be found. May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61857b6-d851-4b88-bd98-b6f0c643c590 could not be found. May 09 20:34:10.482274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:10.484377 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] Returning 404 to user: Instance b61857b6-d851-4b88-bd98-b6f0c643c590 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:10.484377 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-190bf73e-2adc-4070-a184-58cc5e66b731 tempest-VolumesActionsTest-36694844 tempest-VolumesActionsTest-36694844-project] 10.222.0.44 "GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590" status: 404 len: 111 microversion: 2.1 time: 0.035010 May 09 20:34:10.486398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 402/869] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:10 2022] GET /compute/v2.1/servers/b61857b6-d851-4b88-bd98-b6f0c643c590 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:10.576817 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:10.586311 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:10.587906 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:10.589062 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-dc3b9aa8-319f-4a37-843b-349239052b4f tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1717 microversion: 2.20 time: 0.163695 May 09 20:34:10.589620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 468/870] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:34:10 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:34:11.677856 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cf48795d-3685-423a-b876-19373b972e90 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:11.678768 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cf48795d-3685-423a-b876-19373b972e90 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:11.685686 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf48795d-3685-423a-b876-19373b972e90 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:11.686123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf48795d-3685-423a-b876-19373b972e90 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:11.686871 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf48795d-3685-423a-b876-19373b972e90 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:11.687292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf48795d-3685-423a-b876-19373b972e90 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:11.715741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cf48795d-3685-423a-b876-19373b972e90 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 May 09 20:34:11.716277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 403/871] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:34:11 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:11.725976 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2d8f5e80-6fb5-4c1c-befb-7e1cf90814e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:11.726449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2d8f5e80-6fb5-4c1c-befb-7e1cf90814e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:11.732656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8f5e80-6fb5-4c1c-befb-7e1cf90814e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:11.733097 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8f5e80-6fb5-4c1c-befb-7e1cf90814e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:11.733867 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8f5e80-6fb5-4c1c-befb-7e1cf90814e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:11.734297 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2d8f5e80-6fb5-4c1c-befb-7e1cf90814e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:11.762944 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2d8f5e80-6fb5-4c1c-befb-7e1cf90814e9 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/79ee25c8-c175-4301-9363-9f5229a62bfe" status: 200 len: 194 microversion: 2.1 time: 0.040860 May 09 20:34:11.763537 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 469/872] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 9 20:34:11 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/79ee25c8-c175-4301-9363-9f5229a62bfe => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:17.291895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7f5b8d9b-a58e-4582-81d6-13b3d77c8ac8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4baccc12-2337-44f4-9e49-e4259638cbc3"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:34:17.293004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7f5b8d9b-a58e-4582-81d6-13b3d77c8ac8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:17.300816 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f5b8d9b-a58e-4582-81d6-13b3d77c8ac8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:17.301621 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f5b8d9b-a58e-4582-81d6-13b3d77c8ac8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:17.302642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f5b8d9b-a58e-4582-81d6-13b3d77c8ac8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:17.303335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7f5b8d9b-a58e-4582-81d6-13b3d77c8ac8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:17.606604 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7f5b8d9b-a58e-4582-81d6-13b3d77c8ac8 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "POST /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317781 May 09 20:34:17.607880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 404/873] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:34:17 2022] POST /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:25.145708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-db0950cb-2580-4f82-a02f-b05101764d92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:25.146683 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-db0950cb-2580-4f82-a02f-b05101764d92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:25.153803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db0950cb-2580-4f82-a02f-b05101764d92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:25.154485 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db0950cb-2580-4f82-a02f-b05101764d92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:25.155451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db0950cb-2580-4f82-a02f-b05101764d92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:25.156070 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db0950cb-2580-4f82-a02f-b05101764d92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:25.188551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-db0950cb-2580-4f82-a02f-b05101764d92 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047819 May 09 20:34:25.189368 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 470/874] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:34:25 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:25.338135 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-eca70742-2fc9-47d2-b10b-ce4d6e88e344 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:25.338797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-eca70742-2fc9-47d2-b10b-ce4d6e88e344 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:25.348191 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eca70742-2fc9-47d2-b10b-ce4d6e88e344 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:25.349262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eca70742-2fc9-47d2-b10b-ce4d6e88e344 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:25.350465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eca70742-2fc9-47d2-b10b-ce4d6e88e344 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:25.351420 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-eca70742-2fc9-47d2-b10b-ce4d6e88e344 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:25.392123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-eca70742-2fc9-47d2-b10b-ce4d6e88e344 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/79ee25c8-c175-4301-9363-9f5229a62bfe" status: 200 len: 194 microversion: 2.1 time: 0.061729 May 09 20:34:25.402657 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:25.403152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:25.405588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 405/875] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 9 20:34:25 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/79ee25c8-c175-4301-9363-9f5229a62bfe => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:25.410325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:25.410775 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:25.411550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:25.411986 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:25.512720 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lazy-loading 'services' on Instance uuid 4cd76c99-66dc-4600-8826-0c5b607eded9 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:34:25.607446 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4202f193-4ac6-41a3-9801-1f39472b2ba5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/79ee25c8-c175-4301-9363-9f5229a62bfe" status: 202 len: 0 microversion: 2.1 time: 0.208339 May 09 20:34:25.608295 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 471/876] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:34:25 2022] DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/79ee25c8-c175-4301-9363-9f5229a62bfe => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:34:27.810763 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f93748b9-4173-4289-93ed-38beff454399 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:27.811318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f93748b9-4173-4289-93ed-38beff454399 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:27.817968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f93748b9-4173-4289-93ed-38beff454399 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:27.818415 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f93748b9-4173-4289-93ed-38beff454399 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:27.819221 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f93748b9-4173-4289-93ed-38beff454399 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:27.819674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f93748b9-4173-4289-93ed-38beff454399 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:27.851828 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f93748b9-4173-4289-93ed-38beff454399 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/4baccc12-2337-44f4-9e49-e4259638cbc3" status: 200 len: 194 microversion: 2.1 time: 0.045127 May 09 20:34:27.863490 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 406/877] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 9 20:34:27 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/4baccc12-2337-44f4-9e49-e4259638cbc3 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:27.863714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:27.864287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:27.870279 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:27.870726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:27.871506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:27.871953 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:27.962060 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lazy-loading 'services' on Instance uuid 4cd76c99-66dc-4600-8826-0c5b607eded9 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:34:28.035913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e170a1b4-cb8b-4323-b5c4-8e951f7e4fe7 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/4baccc12-2337-44f4-9e49-e4259638cbc3" status: 202 len: 0 microversion: 2.1 time: 0.176309 May 09 20:34:28.036757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 472/878] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:34:27 2022] DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments/4baccc12-2337-44f4-9e49-e4259638cbc3 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 20:34:29.224520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ef87483c-3615-4b39-a6e1-0b0814899254 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:29.226139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ef87483c-3615-4b39-a6e1-0b0814899254 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:29.234222 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef87483c-3615-4b39-a6e1-0b0814899254 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.234974 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef87483c-3615-4b39-a6e1-0b0814899254 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.236012 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef87483c-3615-4b39-a6e1-0b0814899254 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.236442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef87483c-3615-4b39-a6e1-0b0814899254 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.272153 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ef87483c-3615-4b39-a6e1-0b0814899254 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052118 May 09 20:34:29.273014 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 407/879] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:34:29 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:34:29.397975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f662701d-4eb1-48b2-9c35-44b7802f00a4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:29.399122 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f662701d-4eb1-48b2-9c35-44b7802f00a4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:29.407852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f662701d-4eb1-48b2-9c35-44b7802f00a4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.408541 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f662701d-4eb1-48b2-9c35-44b7802f00a4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.409958 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f662701d-4eb1-48b2-9c35-44b7802f00a4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.410543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f662701d-4eb1-48b2-9c35-44b7802f00a4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.447221 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f662701d-4eb1-48b2-9c35-44b7802f00a4 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054124 May 09 20:34:29.447858 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 473/880] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:34:29 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:34:29.514020 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:29.514513 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:29.523820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.524351 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.525363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.525885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.554790 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:34:29.650853 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2046c18f-d06e-45c9-8197-5c50d06b50ee tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 204 len: 0 microversion: 2.1 time: 0.140527 May 09 20:34:29.651759 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 408/881] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:34:29 2022] DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:34:29.660902 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:29.661530 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:29.667981 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.668433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.669210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:29.669651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:29.821211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:29.828894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2fa948ef-b1bc-46c1-b930-0c319371cfc5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1673 microversion: 2.1 time: 0.172693 May 09 20:34:29.829455 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 474/882] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:29 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:34:30.848831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:34:30.849415 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:30.849796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:34:30.849904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:30.856018 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:30.856459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:30.857216 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:30.857640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:31.041056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:31.048400 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4cd5a436-ebc4-4596-ac59-7413957e50ba tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1673 microversion: 2.1 time: 0.203777 May 09 20:34:31.048884 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 409/883] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:30 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:34:32.066065 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:32.066686 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:32.073881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:32.074337 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:32.075363 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:32.075704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:32.286266 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:32.293780 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-94300bf6-77d1-4068-a04e-c33a4808ff70 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1673 microversion: 2.1 time: 0.232067 May 09 20:34:32.294335 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 475/884] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:32 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1673 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:34:33.008201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-088d4957-01ce-4ec1-acad-11038d95be5b req-f634d0ca-6fa9-43f8-9041-ffb70db23017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd76c99-66dc-4600-8826-0c5b607eded9", "name": "network-vif-deleted", "tag": "19962f6a-e324-4cc2-9939-36268c0cdce1"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:34:33.017667 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-088d4957-01ce-4ec1-acad-11038d95be5b req-f634d0ca-6fa9-43f8-9041-ffb70db23017 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:33.018870 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-088d4957-01ce-4ec1-acad-11038d95be5b req-f634d0ca-6fa9-43f8-9041-ffb70db23017 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:33.030576 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-088d4957-01ce-4ec1-acad-11038d95be5b req-f634d0ca-6fa9-43f8-9041-ffb70db23017 service nova] Creating event network-vif-deleted:19962f6a-e324-4cc2-9939-36268c0cdce1 for instance 4cd76c99-66dc-4600-8826-0c5b607eded9 on hv-cinder-83699 May 09 20:34:33.036383 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-088d4957-01ce-4ec1-acad-11038d95be5b req-f634d0ca-6fa9-43f8-9041-ffb70db23017 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034306 May 09 20:34:33.037056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 410/885] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:33.310770 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:33.311377 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:33.318663 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:33.319576 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:33.320460 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:33.320901 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:33.362106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:33.362550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:33.363007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lazy-loading 'fault' on Instance uuid 4cd76c99-66dc-4600-8826-0c5b607eded9 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:34:33.406796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9342c8759514113aeec13ce910e4a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1689d104c0184a36816bb6e361733e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:34:33.421464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-37119cf8-1fcd-4592-be1a-77b71b30af16 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 200 len: 1328 microversion: 2.1 time: 0.114446 May 09 20:34:33.433257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 476/886] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:33 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:34:34.442940 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:34.443740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:34.450630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:34.451093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:34.451923 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:34.452353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:34.466868 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] HTTP exception thrown: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Request method failure captured: May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 HTTP/1.1 May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiRrUBALhtmZfK00Ajz0Qk75020gmBV_LsvJju8vt5WOhIvoW3ZNBIURe69VPC0YFikl2zdReraJrYTKfkbLdgIPzb2z6gXM5rPf-a-gL6q4zogl3oESJAAEFLhs7PcJh5QLpl6q5QtoZsBULk1W6MDqmW36ZsRgbHAImL9vwOBB4o May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:34:34.468559 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1689d104c0184a36816bb6e361733e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1689d104c0184a36816bb6e361733e16"}]}] May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: d9342c8759514113aeec13ce910e4a21 May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:34.470203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '4cd76c99-66dc-4600-8826-0c5b607eded9'} May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:34.471182 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:34.472730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:34.474502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Returning 404 to user: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:34.474502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1d4d0d9d-1834-407d-8b13-1fddaa702e80 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 404 len: 111 microversion: 2.1 time: 0.032619 May 09 20:34:34.474502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 411/887] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:34 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:34.480222 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ed115fd2-01ff-4c03-ab34-9c59cbecab31 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '.version_select at 0x7f62bd32f1f0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:34.499820 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ed115fd2-01ff-4c03-ab34-9c59cbecab31 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467466994" status: 202 len: 0 microversion: 2.1 time: 0.023755 May 09 20:34:34.500396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 477/888] 10.222.0.44 () {58 vars in 1220 bytes} [Mon May 9 20:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467466994 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:34:37.368357 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:37.368823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:37.375049 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:37.375595 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:37.376352 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:37.376788 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:37.390092 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] HTTP exception thrown: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Request method failure captured: May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 HTTP/1.1 May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiRrUBALhtmZfK00Ajz0Qk75020gmBV_LsvJju8vt5WOhIvoW3ZNBIURe69VPC0YFikl2zdReraJrYTKfkbLdgIPzb2z6gXM5rPf-a-gL6q4zogl3oESJAAEFLhs7PcJh5QLpl6q5QtoZsBULk1W6MDqmW36ZsRgbHAImL9vwOBB4o May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:34:37.391628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1689d104c0184a36816bb6e361733e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1689d104c0184a36816bb6e361733e16"}]}] May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: d9342c8759514113aeec13ce910e4a21 May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.393144 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '4cd76c99-66dc-4600-8826-0c5b607eded9'} May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:37.394744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.396195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:37.397990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Returning 404 to user: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:37.397990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-dbb38a9e-0755-47b5-84d2-42e3941323a5 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 404 len: 111 microversion: 2.1 time: 0.028527 May 09 20:34:37.397990 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 412/889] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:34:37 2022] DELETE /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:37.402316 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:37.402948 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 4cd76c99-66dc-4600-8826-0c5b607eded9] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:37.410688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:37.411130 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:37.411903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:37.412326 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:37.425220 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] HTTP exception thrown: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Request method failure captured: May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 HTTP/1.1 May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiRrUBALhtmZfK00Ajz0Qk75020gmBV_LsvJju8vt5WOhIvoW3ZNBIURe69VPC0YFikl2zdReraJrYTKfkbLdgIPzb2z6gXM5rPf-a-gL6q4zogl3oESJAAEFLhs7PcJh5QLpl6q5QtoZsBULk1W6MDqmW36ZsRgbHAImL9vwOBB4o May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:34:37.426952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1689d104c0184a36816bb6e361733e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1689d104c0184a36816bb6e361733e16"}]}] May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: d9342c8759514113aeec13ce910e4a21 May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.428500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '4cd76c99-66dc-4600-8826-0c5b607eded9'} May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:37.429380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. May 09 20:34:37.430655 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:37.431833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Returning 404 to user: Instance 4cd76c99-66dc-4600-8826-0c5b607eded9 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:37.431833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1345de1e-8b7b-42c9-9fa0-ac504a20fc52 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9" status: 404 len: 111 microversion: 2.1 time: 0.030375 May 09 20:34:37.431833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 478/890] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:37 2022] GET /compute/v2.1/servers/4cd76c99-66dc-4600-8826-0c5b607eded9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:38.555992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:38.556462 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:38.562744 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:38.563186 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:38.563979 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:38.564412 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:38.578196 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] HTTP exception thrown: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Request method failure captured: May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: DELETE /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b HTTP/1.1 May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiRrUBALhtmZfK00Ajz0Qk75020gmBV_LsvJju8vt5WOhIvoW3ZNBIURe69VPC0YFikl2zdReraJrYTKfkbLdgIPzb2z6gXM5rPf-a-gL6q4zogl3oESJAAEFLhs7PcJh5QLpl6q5QtoZsBULk1W6MDqmW36ZsRgbHAImL9vwOBB4o May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:34:38.579741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1689d104c0184a36816bb6e361733e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1689d104c0184a36816bb6e361733e16"}]}] May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: d9342c8759514113aeec13ce910e4a21 May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.581285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '5e5859d0-753a-4eb6-9c16-6a21b2a0758b'} May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:38.582880 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.584668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:38.586138 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Returning 404 to user: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:38.586138 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b4c25738-7976-4122-9602-68bd9fd2c8eb tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 404 len: 111 microversion: 2.1 time: 0.029600 May 09 20:34:38.586138 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 413/891] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:34:38 2022] DELETE /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:38.589325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:38.589931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] [instance: 5e5859d0-753a-4eb6-9c16-6a21b2a0758b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:34:38.595820 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:38.596262 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:38.597009 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:34:38.597436 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:34:38.610670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] HTTP exception thrown: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Request method failure captured: May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b HTTP/1.1 May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiRrUBALhtmZfK00Ajz0Qk75020gmBV_LsvJju8vt5WOhIvoW3ZNBIURe69VPC0YFikl2zdReraJrYTKfkbLdgIPzb2z6gXM5rPf-a-gL6q4zogl3oESJAAEFLhs7PcJh5QLpl6q5QtoZsBULk1W6MDqmW36ZsRgbHAImL9vwOBB4o May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:34:38.612164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1689d104c0184a36816bb6e361733e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1689d104c0184a36816bb6e361733e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1689d104c0184a36816bb6e361733e16"}]}] May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 1689d104c0184a36816bb6e361733e16 May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635221143 May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: d9342c8759514113aeec13ce910e4a21 May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeTestJSON-1635221143-project May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.614375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '5e5859d0-753a-4eb6-9c16-6a21b2a0758b'} May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:38.615242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. May 09 20:34:38.616737 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:38.618213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] Returning 404 to user: Instance 5e5859d0-753a-4eb6-9c16-6a21b2a0758b could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:38.618213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ea03300d-b7c8-49ac-9a06-8537482ad303 tempest-AttachVolumeTestJSON-1635221143 tempest-AttachVolumeTestJSON-1635221143-project] 10.222.0.44 "GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b" status: 404 len: 111 microversion: 2.1 time: 0.027876 May 09 20:34:38.618213 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 479/892] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:34:38 2022] GET /compute/v2.1/servers/5e5859d0-753a-4eb6-9c16-6a21b2a0758b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:43.049472 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7373c86f-a7e8-48f9-b0f7-364420c7278a tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Action: 'create', calling method: .version_select at 0x7f62bcbf6d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1927194931"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:34:43.320955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7373c86f-a7e8-48f9-b0f7-364420c7278a tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.380717 May 09 20:34:43.321575 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 414/893] 10.222.0.44 () {60 vars in 1154 bytes} [Mon May 9 20:34:42 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 382 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 20:34:43.333362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0cb617dc-734f-460f-941d-a4e8540e6f25 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd365d30>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:43.382894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0cb617dc-734f-460f-941d-a4e8540e6f25 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f" status: 200 len: 345 microversion: 2.1 time: 0.054027 May 09 20:34:43.383540 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 480/894] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:34:43 2022] GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:44.396504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3e99f8c1-13d9-4e22-bc34-34c894262b13 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bca8e820>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:44.442204 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3e99f8c1-13d9-4e22-bc34-34c894262b13 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f" status: 200 len: 346 microversion: 2.1 time: 0.050390 May 09 20:34:44.442754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 415/895] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:34:44 2022] GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:44.454276 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-68d6cc70-8456-4b56-8520-a8b4f2735bee tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Action: 'create', calling method: .version_select at 0x7f62bd2fcee0>, body: {"snapshot": {"volume_id": "b720a005-283c-40ac-8129-8c8844e82d3f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-960680182"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:34:44.601435 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-68d6cc70-8456-4b56-8520-a8b4f2735bee tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.151378 May 09 20:34:44.602047 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 481/896] 10.222.0.44 () {60 vars in 1161 bytes} [Mon May 9 20:34:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:44.612115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f260513a-bc0c-4e7e-a92b-cf427961859c tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bca93f70>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:44.642525 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f260513a-bc0c-4e7e-a92b-cf427961859c tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 200 len: 286 microversion: 2.1 time: 0.034224 May 09 20:34:44.643087 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 416/897] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:44 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:44.652656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-aded223e-a7dc-4bb4-84c9-829ea01a0ab4 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd3800d0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:44.681008 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-aded223e-a7dc-4bb4-84c9-829ea01a0ab4 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032071 May 09 20:34:44.681557 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 482/898] 10.222.0.44 () {58 vars in 1139 bytes} [Mon May 9 20:34:44 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:44.691261 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cee1ac8b-e9ab-447f-b3fc-a5d72fd80290 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bca770d0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:44.719159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cee1ac8b-e9ab-447f-b3fc-a5d72fd80290 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 200 len: 286 microversion: 2.1 time: 0.031550 May 09 20:34:44.719740 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 417/899] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:44 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:45.732126 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5d333e0b-dedb-4846-bbf6-c8a39442a02f tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd4dd670>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:45.762679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5d333e0b-dedb-4846-bbf6-c8a39442a02f tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 200 len: 286 microversion: 2.1 time: 0.035059 May 09 20:34:45.763247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 483/900] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:45 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:46.775359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-08af384b-2851-49d2-af6d-4cc973aa51e0 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bcac6dc0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:46.804134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-08af384b-2851-49d2-af6d-4cc973aa51e0 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 200 len: 286 microversion: 2.1 time: 0.033651 May 09 20:34:46.804682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 418/901] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:46 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:47.815175 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-88689934-ff5d-49a5-9dae-8c5bbf38fcc8 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd3103a0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:47.843724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-88689934-ff5d-49a5-9dae-8c5bbf38fcc8 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 200 len: 286 microversion: 2.1 time: 0.032750 May 09 20:34:47.844303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 484/902] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:47 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:48.857388 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aa31aa59-24e9-49ef-b3a3-01c257a05e36 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bca779d0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:48.885895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-aa31aa59-24e9-49ef-b3a3-01c257a05e36 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 200 len: 287 microversion: 2.1 time: 0.032644 May 09 20:34:48.886530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 419/903] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:48 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:48.896875 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6af9c7ce-c934-4b19-825b-8972f7250fe2 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd365310>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:48.949933 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6af9c7ce-c934-4b19-825b-8972f7250fe2 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 202 len: 0 microversion: 2.1 time: 0.057248 May 09 20:34:48.950486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 485/904] 10.222.0.44 () {58 vars in 1253 bytes} [Mon May 9 20:34:48 2022] DELETE /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:34:48.958565 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cea210a0-e686-484c-afec-1ab95b44e2a6 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bca93940>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:48.987136 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cea210a0-e686-484c-afec-1ab95b44e2a6 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 200 len: 286 microversion: 2.1 time: 0.032306 May 09 20:34:48.987764 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 420/905] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:48 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:49.999857 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2cc74f87-a3d0-408c-a4b6-66f5d6d61314 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd3800d0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:50.024563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-2cc74f87-a3d0-408c-a4b6-66f5d6d61314 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] HTTP exception thrown: Snapshot 12067255-8cd0-4c3f-a02f-1429b7ba3a9e could not be found. May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2cc74f87-a3d0-408c-a4b6-66f5d6d61314 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Request method failure captured: May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e HTTP/1.1 May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXriE7k8lsP0_ct1iwUX8_c9ikQ5G8wtRqSMZjMB8mEjuqPxV76ek22chuIux7CVxfy7VGGvhf6cJUOscB5z3Rq8F3OJLDNx5mOTz4eoQADyCmsf-3qZJ0SYwMi6ii04Dng27MwBzhDKeY1dtQ_HyKVwroOeKCKFENH2EN4JcUiUxhs May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:34:50.027739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/35bee25bb75b4c47ade16f1dd2cc0a79"}]}] May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 130d833489e540cca9333bc60990de72 May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Snapshot 12067255-8cd0-4c3f-a02f-1429b7ba3a9e could not be found. May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '12067255-8cd0-4c3f-a02f-1429b7ba3a9e'} May 09 20:34:50.029272 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 12067255-8cd0-4c3f-a02f-1429b7ba3a9e could not be found. (HTTP 404) (Request-ID: req-a00685a9-8f0a-4205-88cf-9fbbdd1c0603) May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:50.030380 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:34:50.031740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 12067255-8cd0-4c3f-a02f-1429b7ba3a9e could not be found. May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 09 20:34:50.033237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 12067255-8cd0-4c3f-a02f-1429b7ba3a9e could not be found. May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 12067255-8cd0-4c3f-a02f-1429b7ba3a9e could not be found. May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2cc74f87-a3d0-408c-a4b6-66f5d6d61314 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Returning 404 to user: Snapshot 12067255-8cd0-4c3f-a02f-1429b7ba3a9e could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2cc74f87-a3d0-408c-a4b6-66f5d6d61314 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e" status: 404 len: 111 microversion: 2.1 time: 0.033642 May 09 20:34:50.034611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 486/906] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:34:49 2022] GET /compute/v2.1/os-snapshots/12067255-8cd0-4c3f-a02f-1429b7ba3a9e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:50.038394 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5c62a08a-cf2c-4042-b730-5d4da4335c84 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bcab4dc0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:50.095877 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5c62a08a-cf2c-4042-b730-5d4da4335c84 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f" status: 202 len: 0 microversion: 2.1 time: 0.061730 May 09 20:34:50.096441 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 421/907] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:34:50 2022] DELETE /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:34:50.111289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-afe775c8-157f-4ccc-b720-8ce065306f9f tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd3104c0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:50.158762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-afe775c8-157f-4ccc-b720-8ce065306f9f tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f" status: 200 len: 345 microversion: 2.1 time: 0.057059 May 09 20:34:50.159315 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 487/908] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:34:50 2022] GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:34:50.303971 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:34:50.304172 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:34:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:34:51.172208 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-756f0083-868d-4add-a337-9fb2b7e22f68 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bca93280>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:51.198705 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-756f0083-868d-4add-a337-9fb2b7e22f68 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] HTTP exception thrown: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-756f0083-868d-4add-a337-9fb2b7e22f68 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Request method failure captured: May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f HTTP/1.1 May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXriE7k8lsP0_ct1iwUX8_c9ikQ5G8wtRqSMZjMB8mEjuqPxV76ek22chuIux7CVxfy7VGGvhf6cJUOscB5z3Rq8F3OJLDNx5mOTz4eoQADyCmsf-3qZJ0SYwMi6ii04Dng27MwBzhDKeY1dtQ_HyKVwroOeKCKFENH2EN4JcUiUxhs May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:34:51.200675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/35bee25bb75b4c47ade16f1dd2cc0a79"}]}] May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 130d833489e540cca9333bc60990de72 May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'b720a005-283c-40ac-8129-8c8844e82d3f'} May 09 20:34:51.202207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. (HTTP 404) (Request-ID: req-901755d1-7ca8-4bc6-b703-73152235f3ff) May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.203101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:34:51.204476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 20:34:51.205862 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-756f0083-868d-4add-a337-9fb2b7e22f68 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Returning 404 to user: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-756f0083-868d-4add-a337-9fb2b7e22f68 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f" status: 404 len: 109 microversion: 2.1 time: 0.034389 May 09 20:34:51.207239 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 422/909] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:34:51 2022] GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:51.216880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5f29ed22-3253-4f5c-9e56-59ab232c1e0e tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bd365a60>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:51.243387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-5f29ed22-3253-4f5c-9e56-59ab232c1e0e tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] HTTP exception thrown: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5f29ed22-3253-4f5c-9e56-59ab232c1e0e tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Request method failure captured: May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f HTTP/1.1 May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXriE7k8lsP0_ct1iwUX8_c9ikQ5G8wtRqSMZjMB8mEjuqPxV76ek22chuIux7CVxfy7VGGvhf6cJUOscB5z3Rq8F3OJLDNx5mOTz4eoQADyCmsf-3qZJ0SYwMi6ii04Dng27MwBzhDKeY1dtQ_HyKVwroOeKCKFENH2EN4JcUiUxhs May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:34:51.245760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/35bee25bb75b4c47ade16f1dd2cc0a79"}]}] May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 130d833489e540cca9333bc60990de72 May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': 'b720a005-283c-40ac-8129-8c8844e82d3f'} May 09 20:34:51.247268 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. (HTTP 404) (Request-ID: req-038c2820-e07e-4ac5-ae44-c51c367c512e) May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.248235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 20:34:51.249414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 20:34:51.250620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5f29ed22-3253-4f5c-9e56-59ab232c1e0e tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Returning 404 to user: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5f29ed22-3253-4f5c-9e56-59ab232c1e0e tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f" status: 404 len: 109 microversion: 2.1 time: 0.034490 May 09 20:34:51.251903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 488/910] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:34:51 2022] DELETE /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:34:51.256613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-214ab383-840a-4814-a242-3fcfbf3f9d19 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Calling method '.version_select at 0x7f62bcab4f70>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:34:51.283857 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-214ab383-840a-4814-a242-3fcfbf3f9d19 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] HTTP exception thrown: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-214ab383-840a-4814-a242-3fcfbf3f9d19 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Request method failure captured: May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f HTTP/1.1 May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXriE7k8lsP0_ct1iwUX8_c9ikQ5G8wtRqSMZjMB8mEjuqPxV76ek22chuIux7CVxfy7VGGvhf6cJUOscB5z3Rq8F3OJLDNx5mOTz4eoQADyCmsf-3qZJ0SYwMi6ii04Dng27MwBzhDKeY1dtQ_HyKVwroOeKCKFENH2EN4JcUiUxhs May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:34:51.285734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35bee25bb75b4c47ade16f1dd2cc0a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/35bee25bb75b4c47ade16f1dd2cc0a79"}]}] May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 35bee25bb75b4c47ade16f1dd2cc0a79 May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567757644 May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 130d833489e540cca9333bc60990de72 May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567757644-project May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'b720a005-283c-40ac-8129-8c8844e82d3f'} May 09 20:34:51.287981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. (HTTP 404) (Request-ID: req-9bdd1bff-9ca9-4868-a6e9-0620f0c82283) May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.288926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 20:34:51.290285 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 20:34:51.291797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-214ab383-840a-4814-a242-3fcfbf3f9d19 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] Returning 404 to user: Volume b720a005-283c-40ac-8129-8c8844e82d3f could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-214ab383-840a-4814-a242-3fcfbf3f9d19 tempest-VolumesSnapshotsTestJSON-567757644 tempest-VolumesSnapshotsTestJSON-567757644-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f" status: 404 len: 109 microversion: 2.1 time: 0.035620 May 09 20:34:51.293143 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 423/911] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 20:34:51 2022] GET /compute/v2.1/os-volumes/b720a005-283c-40ac-8129-8c8844e82d3f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:06.297241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5fd04280-b253-4a32-91c4-a11737d66d87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:06.297856 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5fd04280-b253-4a32-91c4-a11737d66d87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:06.303912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fd04280-b253-4a32-91c4-a11737d66d87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:06.304563 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fd04280-b253-4a32-91c4-a11737d66d87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:06.305320 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fd04280-b253-4a32-91c4-a11737d66d87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:06.305746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5fd04280-b253-4a32-91c4-a11737d66d87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:06.329493 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5fd04280-b253-4a32-91c4-a11737d66d87 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/ips" status: 200 len: 149 microversion: 2.1 time: 0.037453 May 09 20:35:06.330067 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 489/912] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 20:35:06 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:35:07.659911 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-632b4639-899f-44b3-b47e-fd73951159aa tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e53bf5b0-2a78-40ff-825e-c82ee57d9464"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:35:07.660981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-632b4639-899f-44b3-b47e-fd73951159aa tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:07.667385 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-632b4639-899f-44b3-b47e-fd73951159aa tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:07.667854 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-632b4639-899f-44b3-b47e-fd73951159aa tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:07.668612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-632b4639-899f-44b3-b47e-fd73951159aa tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:07.669040 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-632b4639-899f-44b3-b47e-fd73951159aa tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:07.924675 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-632b4639-899f-44b3-b47e-fd73951159aa tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "POST /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268948 May 09 20:35:07.925279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 424/913] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:35:07 2022] POST /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:35:15.507822 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:15.508573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:15.515376 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:15.515993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:15.516836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:15.517351 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:15.600954 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lazy-loading 'services' on Instance uuid 076708ed-794d-4b76-9ece-a8eb73bb3a67 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:35:15.670883 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-15d97bdd-4d74-42d5-a225-5ff9dac344ad tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments/e53bf5b0-2a78-40ff-825e-c82ee57d9464" status: 202 len: 0 microversion: 2.1 time: 0.167576 May 09 20:35:15.671520 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 490/914] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:35:15 2022] DELETE /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments/e53bf5b0-2a78-40ff-825e-c82ee57d9464 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:35:15.682616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6775af59-a4f5-4e20-8828-96ed8c29937b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:15.683631 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6775af59-a4f5-4e20-8828-96ed8c29937b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:15.690552 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6775af59-a4f5-4e20-8828-96ed8c29937b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:15.691005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6775af59-a4f5-4e20-8828-96ed8c29937b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:15.692625 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6775af59-a4f5-4e20-8828-96ed8c29937b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:15.693082 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6775af59-a4f5-4e20-8828-96ed8c29937b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:15.725342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6775af59-a4f5-4e20-8828-96ed8c29937b tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048643 May 09 20:35:15.725920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 425/915] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:35:15 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:35:16.737726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1caaa398-aa15-42a1-9957-f1e55d0bd240 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:16.738829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1caaa398-aa15-42a1-9957-f1e55d0bd240 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:16.745250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1caaa398-aa15-42a1-9957-f1e55d0bd240 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:16.745688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1caaa398-aa15-42a1-9957-f1e55d0bd240 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:16.746434 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1caaa398-aa15-42a1-9957-f1e55d0bd240 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:16.746861 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1caaa398-aa15-42a1-9957-f1e55d0bd240 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:16.775805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1caaa398-aa15-42a1-9957-f1e55d0bd240 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042288 May 09 20:35:16.776379 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 491/916] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:35:16 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:35:16.831725 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:16.832184 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:16.839203 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:16.839701 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:16.840466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:16.840894 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:16.866499 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:35:16.952663 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3520bc02-1785-46f9-8331-e5e0a7ed0746 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 204 len: 0 microversion: 2.1 time: 0.124442 May 09 20:35:16.953505 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 426/917] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:35:16 2022] DELETE /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:35:16.974172 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:16.974913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:16.980943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:16.981396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:16.982169 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:16.982607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:17.117721 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:17.125483 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2b57920b-f794-440f-bafc-fec89ba23061 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1681 microversion: 2.1 time: 0.162228 May 09 20:35:17.126036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 492/918] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:16 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:35:17.664729 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-59313234-bb8b-4ddf-9c9a-c34c4823a880 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:17.665762 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-59313234-bb8b-4ddf-9c9a-c34c4823a880 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:17.672095 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59313234-bb8b-4ddf-9c9a-c34c4823a880 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:17.672542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59313234-bb8b-4ddf-9c9a-c34c4823a880 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:17.673301 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59313234-bb8b-4ddf-9c9a-c34c4823a880 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:17.673728 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-59313234-bb8b-4ddf-9c9a-c34c4823a880 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:17.701281 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-59313234-bb8b-4ddf-9c9a-c34c4823a880 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041427 May 09 20:35:17.701822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 427/919] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 9 20:35:17 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:35:17.756742 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:17.757242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:17.763797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:17.764238 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:17.764985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:17.765413 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:17.790835 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:35:17.862631 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ceb49a94-e3d0-416c-b09f-c943cc48e6a4 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 204 len: 0 microversion: 2.20 time: 0.109317 May 09 20:35:17.863287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 493/920] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 20:35:17 2022] DELETE /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 20:35:17.871468 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:17.872081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:17.878496 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:17.878983 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:17.879809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:17.880238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:18.007565 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:18.015539 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:18.017017 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:18.018155 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ecd6491c-5713-41f4-87a6-3cd456b2fb0b tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.150674 May 09 20:35:18.018705 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 428/921] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:35:17 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:35:18.144799 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:18.145471 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:18.152406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:18.152907 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:18.153672 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:18.154111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:18.282864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:18.290326 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-deb19400-a5f4-44f3-9d28-03289062aaf6 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1681 microversion: 2.1 time: 0.149808 May 09 20:35:18.290891 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 494/922] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:18 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:35:19.037117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:19.038264 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:19.044818 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:19.045273 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:19.046031 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:19.046465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:19.172569 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:19.180501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:19.182001 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:19.183147 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6512d07e-1eab-4400-a383-31526b49279d tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.149972 May 09 20:35:19.183736 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 429/923] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:35:19 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:35:19.307855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:19.308382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:19.314761 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:19.315255 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:19.316043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:19.316473 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:19.449995 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:19.457151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-86fb2ab9-7756-4535-81b8-478819eeed52 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1681 microversion: 2.1 time: 0.153276 May 09 20:35:19.457703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 495/924] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:19 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:35:20.201803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:20.202465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:20.208834 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:20.209308 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:20.210442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:20.210881 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:20.474049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:20.474656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:20.481596 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:20.482035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:20.482787 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:20.483212 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:20.546700 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee809a4a41f4d2c91edb83c1f4d224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe87375072b4dbbaac833caf2f705aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:20.554590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:20.554780 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d76f3dad-69c2-4145-b315-7ff006f536b8 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 200 len: 1614 microversion: 2.1 time: 0.084484 May 09 20:35:20.555275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 496/925] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:20 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:35:20.564638 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:20.566343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:20.567715 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-acffcac9-72b7-41ee-879a-844067487f75 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1723 microversion: 2.20 time: 0.369913 May 09 20:35:20.568378 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 430/926] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:35:20 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 20:35:21.150046 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-48fca3e3-6050-44c4-b9ae-aeb1b9c6a61b req-afec59ad-ab58-4fb4-abb9-5123583aac23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076708ed-794d-4b76-9ece-a8eb73bb3a67", "name": "network-vif-deleted", "tag": "1466f16d-53c3-41b2-af75-c669563ff0bd"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:35:21.159149 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-48fca3e3-6050-44c4-b9ae-aeb1b9c6a61b req-afec59ad-ab58-4fb4-abb9-5123583aac23 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:21.159630 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-48fca3e3-6050-44c4-b9ae-aeb1b9c6a61b req-afec59ad-ab58-4fb4-abb9-5123583aac23 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:21.172544 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-48fca3e3-6050-44c4-b9ae-aeb1b9c6a61b req-afec59ad-ab58-4fb4-abb9-5123583aac23 service nova] Creating event network-vif-deleted:1466f16d-53c3-41b2-af75-c669563ff0bd for instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 on hv-cinder-83699 May 09 20:35:21.179357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-48fca3e3-6050-44c4-b9ae-aeb1b9c6a61b req-afec59ad-ab58-4fb4-abb9-5123583aac23 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239522 May 09 20:35:21.180299 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 497/927] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:35:21.582994 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:21.583378 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:21.590579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:21.591324 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:21.592326 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:21.592775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:21.593545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:21.593977 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:21.607151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:21.607785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:21.608583 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:21.609029 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:21.616265 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 HTTP/1.1 May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:21.618530 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:21.620579 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '076708ed-794d-4b76-9ece-a8eb73bb3a67'} May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:21.621397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:21.622681 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:21.623848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:21.623848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-56e1411d-3ae3-40d5-9ac5-4d3d9f83dfa0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 404 len: 111 microversion: 2.1 time: 0.048769 May 09 20:35:21.624537 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 431/928] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:21 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:21.629891 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6b219437-15d9-4ea8-84e1-a36d5771b146 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '.version_select at 0x7f62bca91430>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:21.657691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6b219437-15d9-4ea8-84e1-a36d5771b146 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586583854" status: 202 len: 0 microversion: 2.1 time: 0.031453 May 09 20:35:21.666122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 432/929] 10.222.0.44 () {58 vars in 1220 bytes} [Mon May 9 20:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586583854 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:35:21.724330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:21.738259 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:21.741137 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38716aefb55246079de2658159fd5ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f579878e20bc40d282c9c38200581b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:35:21.743289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fb4b1e65-e04d-4cc4-915a-35bd94ad9a53 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 200 len: 1366 microversion: 2.20 time: 0.160411 May 09 20:35:21.744394 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 498/930] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:35:21 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 20:35:22.764669 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:22.766090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:22.776588 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:22.777071 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:22.778131 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:22.778628 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:22.797250 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] HTTP exception thrown: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Request method failure captured: May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 HTTP/1.1 May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiTSlceEgDk15COdtvAeV5fCA0pjVy0soZz2xd8Nk5TXKKR7Y3aWDGIRTEZ7ueV0wf4LxW7ykfOadKZbdNKNv0cHo2I5DykNbGAOuscEpB8SBt43mqdw_QEqeMJ_6jqn6Voa1HCZy9TaucsUgV46yXw2XrodCNw8Q2L3S0J_cUuBxc May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Openstack-Nova-Api-Version: 2.20 May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:22.799380 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f579878e20bc40d282c9c38200581b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f579878e20bc40d282c9c38200581b98"}]}] May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 38716aefb55246079de2658159fd5ca4 May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:22.800869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'eeee17c4-5609-4625-accc-1b95b2010b31'} May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:22.801664 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:22.802867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:22.804914 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Returning 404 to user: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:22.804914 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ecffd9e7-ad2a-48ca-b54d-422c8423219a tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 404 len: 111 microversion: 2.20 time: 0.043653 May 09 20:35:22.804914 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 433/931] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:35:22 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 20:35:22.811161 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-23c7fc46-006f-4ce9-936e-4886d2930d07 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '.version_select at 0x7f62bd40c160>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:22.846622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-23c7fc46-006f-4ce9-936e-4886d2930d07 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575899967" status: 204 len: 0 microversion: 2.20 time: 0.039563 May 09 20:35:22.851601 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 499/932] 10.222.0.44 () {60 vars in 1258 bytes} [Mon May 9 20:35:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575899967 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 20:35:23.264010 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-e6cd56d4-5d26-4ff4-ad64-38344837f4c4 req-25a93b69-293e-45f9-9807-dfc19ea0f2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeee17c4-5609-4625-accc-1b95b2010b31", "name": "network-vif-deleted", "tag": "96f29356-267d-448b-b032-8d87f2262256"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:35:23.272991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-e6cd56d4-5d26-4ff4-ad64-38344837f4c4 req-25a93b69-293e-45f9-9807-dfc19ea0f2f9 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:23.273760 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-e6cd56d4-5d26-4ff4-ad64-38344837f4c4 req-25a93b69-293e-45f9-9807-dfc19ea0f2f9 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:23.284927 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-e6cd56d4-5d26-4ff4-ad64-38344837f4c4 req-25a93b69-293e-45f9-9807-dfc19ea0f2f9 service nova] Creating event network-vif-deleted:96f29356-267d-448b-b032-8d87f2262256 for instance eeee17c4-5609-4625-accc-1b95b2010b31 on hv-cinder-83699 May 09 20:35:23.291470 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-e6cd56d4-5d26-4ff4-ad64-38344837f4c4 req-25a93b69-293e-45f9-9807-dfc19ea0f2f9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031207 May 09 20:35:23.292392 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 434/933] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:35:23.613309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:23.613309 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:23.619375 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:23.619844 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:23.620603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:23.624612 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:23.641653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 HTTP/1.1 May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:35:23.641942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.643569 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '076708ed-794d-4b76-9ece-a8eb73bb3a67'} May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:23.644424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.646275 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:23.648287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:23.648287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-db9f6ff3-eab3-429c-8159-1c5b6d17b094 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 404 len: 111 microversion: 2.1 time: 0.035649 May 09 20:35:23.648287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 500/934] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:35:23 2022] DELETE /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:23.652753 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:23.653661 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 076708ed-794d-4b76-9ece-a8eb73bb3a67] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:23.659809 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:23.660252 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:23.661021 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:23.661447 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:23.674726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 HTTP/1.1 May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:23.676373 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.677950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '076708ed-794d-4b76-9ece-a8eb73bb3a67'} May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:23.679647 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. May 09 20:35:23.681190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:23.682720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance 076708ed-794d-4b76-9ece-a8eb73bb3a67 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:23.682720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a1733010-4c97-44fd-a7e8-88388a7a7bf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67" status: 404 len: 111 microversion: 2.1 time: 0.032967 May 09 20:35:23.682720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 435/935] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:23 2022] GET /compute/v2.1/servers/076708ed-794d-4b76-9ece-a8eb73bb3a67 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 20:35:24.702503 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:24.702979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:24.709243 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.710263 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.711007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.711449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.724188 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] HTTP exception thrown: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Request method failure captured: May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 HTTP/1.1 May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiTSlceEgDk15COdtvAeV5fCA0pjVy0soZz2xd8Nk5TXKKR7Y3aWDGIRTEZ7ueV0wf4LxW7ykfOadKZbdNKNv0cHo2I5DykNbGAOuscEpB8SBt43mqdw_QEqeMJ_6jqn6Voa1HCZy9TaucsUgV46yXw2XrodCNw8Q2L3S0J_cUuBxc May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Openstack-Nova-Api-Version: 2.20 May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:35:24.725887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f579878e20bc40d282c9c38200581b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f579878e20bc40d282c9c38200581b98"}]}] May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 38716aefb55246079de2658159fd5ca4 May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.727538 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': 'eeee17c4-5609-4625-accc-1b95b2010b31'} May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:24.728398 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.729814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.731274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Returning 404 to user: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:24.731274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-202ecac9-4d3d-4797-acaf-84b52024e8aa tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 404 len: 111 microversion: 2.20 time: 0.028884 May 09 20:35:24.731274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 501/936] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 20:35:24 2022] DELETE /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 20:35:24.735707 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:24.736315 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: eeee17c4-5609-4625-accc-1b95b2010b31] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:24.742632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.743079 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.743855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.744284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.757586 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] HTTP exception thrown: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Request method failure captured: May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 HTTP/1.1 May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiTSlceEgDk15COdtvAeV5fCA0pjVy0soZz2xd8Nk5TXKKR7Y3aWDGIRTEZ7ueV0wf4LxW7ykfOadKZbdNKNv0cHo2I5DykNbGAOuscEpB8SBt43mqdw_QEqeMJ_6jqn6Voa1HCZy9TaucsUgV46yXw2XrodCNw8Q2L3S0J_cUuBxc May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Openstack-Nova-Api-Version: 2.20 May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:24.759046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f579878e20bc40d282c9c38200581b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f579878e20bc40d282c9c38200581b98"}]}] May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 38716aefb55246079de2658159fd5ca4 May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.760893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'eeee17c4-5609-4625-accc-1b95b2010b31'} May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:24.761726 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. May 09 20:35:24.763166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.764489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Returning 404 to user: Instance eeee17c4-5609-4625-accc-1b95b2010b31 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:24.764489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-828cf5e6-2e0c-4ad9-af5e-34a1b5b08870 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31" status: 404 len: 111 microversion: 2.20 time: 0.028634 May 09 20:35:24.764489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 436/937] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:35:24 2022] GET /compute/v2.1/servers/eeee17c4-5609-4625-accc-1b95b2010b31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 20:35:24.817596 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:24.818107 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:24.825108 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.825603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.826577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.827028 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.841686 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 HTTP/1.1 May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:35:24.843124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.844724 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '19192fd8-c8e0-47e5-bff9-d1151fe03eb5'} May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:24.848979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.850433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.852246 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:24.852246 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c487043f-cee5-44c8-b851-582f9a16abb3 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 404 len: 111 microversion: 2.1 time: 0.030942 May 09 20:35:24.852246 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 502/938] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:35:24 2022] DELETE /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:24.857155 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:24.858180 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: 19192fd8-c8e0-47e5-bff9-d1151fe03eb5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:24.871922 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.872358 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.873197 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.873601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.887646 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 HTTP/1.1 May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:24.889270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.890618 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '19192fd8-c8e0-47e5-bff9-d1151fe03eb5'} May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:24.891360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. May 09 20:35:24.892571 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.893780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance 19192fd8-c8e0-47e5-bff9-d1151fe03eb5 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:24.893780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-49d3ca7f-2fad-437a-9d10-58512e42b8ba tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5" status: 404 len: 111 microversion: 2.1 time: 0.041369 May 09 20:35:24.893780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 437/939] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:24 2022] GET /compute/v2.1/servers/19192fd8-c8e0-47e5-bff9-d1151fe03eb5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:24.899338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:24.899894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:24.912491 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.912957 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.913756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.914182 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.928033 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 HTTP/1.1 May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:35:24.929945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.931521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': 'c597e2ce-b43c-488d-95b1-dbabe035c2b5'} May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:24.932391 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.933851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:24.935287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:24.935287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-df9f73bb-e766-4d97-ba16-852c406c905e tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 404 len: 111 microversion: 2.1 time: 0.035834 May 09 20:35:24.935287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 503/940] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:35:24 2022] DELETE /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:24.939807 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:24.940414 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: c597e2ce-b43c-488d-95b1-dbabe035c2b5] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:24.947175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.947731 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.948536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:24.949214 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:24.962944 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 HTTP/1.1 May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:24.964448 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.966022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'c597e2ce-b43c-488d-95b1-dbabe035c2b5'} May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:24.966822 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. May 09 20:35:24.968078 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:24.969451 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance c597e2ce-b43c-488d-95b1-dbabe035c2b5 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:24.969451 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4fbbbb6e-a463-48ff-9c7e-c4ecd1615a96 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5" status: 404 len: 111 microversion: 2.1 time: 0.029825 May 09 20:35:24.969451 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 438/941] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:24 2022] GET /compute/v2.1/servers/c597e2ce-b43c-488d-95b1-dbabe035c2b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:25.898617 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:25.899134 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:25.905328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:25.905768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:25.906516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:25.906942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:25.919707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] HTTP exception thrown: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Request method failure captured: May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f HTTP/1.1 May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiTSlceEgDk15COdtvAeV5fCA0pjVy0soZz2xd8Nk5TXKKR7Y3aWDGIRTEZ7ueV0wf4LxW7ykfOadKZbdNKNv0cHo2I5DykNbGAOuscEpB8SBt43mqdw_QEqeMJ_6jqn6Voa1HCZy9TaucsUgV46yXw2XrodCNw8Q2L3S0J_cUuBxc May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Openstack-Nova-Api-Version: 2.20 May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:35:25.921233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f579878e20bc40d282c9c38200581b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f579878e20bc40d282c9c38200581b98"}]}] May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 38716aefb55246079de2658159fd5ca4 May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.922802 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '425e8732-2c2b-4c37-b2c3-e766712d293f'} May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:25.923691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.925131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:25.926805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Returning 404 to user: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:25.926805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ac631e01-66bb-410f-bdd0-fdd86c38e329 tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "DELETE /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 404 len: 111 microversion: 2.20 time: 0.028167 May 09 20:35:25.926805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 504/942] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 20:35:25 2022] DELETE /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 20:35:25.932274 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:25.932889 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] [instance: 425e8732-2c2b-4c37-b2c3-e766712d293f] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:25.939123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:25.939606 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:25.940362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:25.940797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:25.954732 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] HTTP exception thrown: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Request method failure captured: May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f HTTP/1.1 May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiTSlceEgDk15COdtvAeV5fCA0pjVy0soZz2xd8Nk5TXKKR7Y3aWDGIRTEZ7ueV0wf4LxW7ykfOadKZbdNKNv0cHo2I5DykNbGAOuscEpB8SBt43mqdw_QEqeMJ_6jqn6Voa1HCZy9TaucsUgV46yXw2XrodCNw8Q2L3S0J_cUuBxc May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Openstack-Nova-Api-Version: 2.20 May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:25.956271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f579878e20bc40d282c9c38200581b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f579878e20bc40d282c9c38200581b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f579878e20bc40d282c9c38200581b98"}]}] May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: f579878e20bc40d282c9c38200581b98 May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116624676 May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 38716aefb55246079de2658159fd5ca4 May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116624676-project May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.957892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '425e8732-2c2b-4c37-b2c3-e766712d293f'} May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:25.959065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. May 09 20:35:25.960666 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:25.961973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] Returning 404 to user: Instance 425e8732-2c2b-4c37-b2c3-e766712d293f could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:25.961973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9b064539-e489-49ff-9acf-41703add15df tempest-AttachVolumeShelveTestJSON-1116624676 tempest-AttachVolumeShelveTestJSON-1116624676-project] 10.222.0.44 "GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f" status: 404 len: 111 microversion: 2.20 time: 0.029983 May 09 20:35:25.961973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 439/943] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 20:35:25 2022] GET /compute/v2.1/servers/425e8732-2c2b-4c37-b2c3-e766712d293f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 20:35:26.099497 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:26.100065 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:26.106178 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:26.106632 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:26.107424 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:26.107965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:26.121763 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae HTTP/1.1 May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:35:26.123318 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.124912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': 'fbed4907-edef-46b3-a625-306d3f840aae'} May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:26.125797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.126993 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:35:26.128322 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:26.128322 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5c78ddaf-6058-484e-8eee-c3e11edf5cf0 tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 404 len: 111 microversion: 2.1 time: 0.029101 May 09 20:35:26.128322 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 505/944] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:35:26 2022] DELETE /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:35:26.134827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:35:26.135939 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] [instance: fbed4907-edef-46b3-a625-306d3f840aae] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:35:26.142013 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:26.142535 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:26.143372 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:35:26.143906 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:35:26.157569 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] HTTP exception thrown: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Request method failure captured: May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae HTTP/1.1 May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXiIR7NXvEAWhTN7DDUYyCOKqe4Nt3TlHJvYVOxqLqo5dDZSSkEviCTSlFAPABfmbOoN6iublxHBiYMj7vtnYw0W__bG6eRnFqDxS1wvDkimcXKyiPlLYtvDUaTHp6-pZ7D--FIlyL1GdN8za_3MuKYnz4AveZpysCHM6HzJP8ZhgC4 May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:35:26.159066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5fe87375072b4dbbaac833caf2f705aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5fe87375072b4dbbaac833caf2f705aa"}]}] May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5fe87375072b4dbbaac833caf2f705aa May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-532270065 May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: dee809a4a41f4d2c91edb83c1f4d224c May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-AttachVolumeNegativeTest-532270065-project May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.160682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'fbed4907-edef-46b3-a625-306d3f840aae'} May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:35:26.161504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. May 09 20:35:26.162935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:35:26.164323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] Returning 404 to user: Instance fbed4907-edef-46b3-a625-306d3f840aae could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:35:26.164323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9ccca93e-fb88-45a4-b0d2-ce9a833866bb tempest-AttachVolumeNegativeTest-532270065 tempest-AttachVolumeNegativeTest-532270065-project] 10.222.0.44 "GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae" status: 404 len: 111 microversion: 2.1 time: 0.030540 May 09 20:35:26.164323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 440/945] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:35:26 2022] GET /compute/v2.1/servers/fbed4907-edef-46b3-a625-306d3f840aae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:36:08.049239 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-924300002", "imageRef": "06e551c2-923b-42d3-8eb4-3addb6c32a94", "flavorRef": "452"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:36:08.098967 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] validate_networks() for None {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:36:08.364519 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:36:08.364936 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:36:08.365399 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:36:08.365798 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:36:08.366200 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:36:08.375314 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:08.375780 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:08.376560 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:08.376990 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:08.392792 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Getting quotas for project 5c2236bae25a403e87f16039620cac17. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:36:08.396516 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Getting quotas for user 925d362ab9e847f281d212a8b5b630a4 and project 5c2236bae25a403e87f16039620cac17. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:36:08.407172 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:36:08.409396 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e551c2-923b-42d3-8eb4-3addb6c32a94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:36:08.455092 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e5dce3e1-9ffd-4b82-83d9-2da0a25cdd24 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.409718 May 09 20:36:08.455755 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 506/946] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:36:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:36:08.466149 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-1cb727f8-49cd-4b0d-8d4d-7bb831c92aa5 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:08.466794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-1cb727f8-49cd-4b0d-8d4d-7bb831c92aa5 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:08.523626 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-1cb727f8-49cd-4b0d-8d4d-7bb831c92aa5 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:08.530688 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-1cb727f8-49cd-4b0d-8d4d-7bb831c92aa5 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1214 microversion: 2.1 time: 0.069009 May 09 20:36:08.531271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 441/947] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:08 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:09.548456 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:09.550859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:09.559186 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:09.559570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:09.560344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:09.560777 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:09.628553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:09.636306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8703d91b-92cf-48aa-bcdf-9dc52f225ce0 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1272 microversion: 2.1 time: 0.092076 May 09 20:36:09.636867 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 507/948] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:09 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:10.653829 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:10.654369 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:10.662102 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:10.662546 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:10.663341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:10.663786 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:10.882125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:10.890478 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ca2b19df-7d7f-4426-9b8f-36836f0ee620 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.240752 May 09 20:36:10.891362 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 442/949] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:10 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:11.099837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-0dacb6ea-9fe9-4a00-9ada-9cf7e4a33f39 req-18c5af64-8cea-4dec-9b35-c434669202b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca07e45-698f-4d2f-a558-62b184be9228", "tag": "aba57bc8-f015-482d-bb33-afc7061216d5"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:36:11.129868 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0dacb6ea-9fe9-4a00-9ada-9cf7e4a33f39 req-18c5af64-8cea-4dec-9b35-c434669202b1 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:11.130814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0dacb6ea-9fe9-4a00-9ada-9cf7e4a33f39 req-18c5af64-8cea-4dec-9b35-c434669202b1 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:11.144507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-0dacb6ea-9fe9-4a00-9ada-9cf7e4a33f39 req-18c5af64-8cea-4dec-9b35-c434669202b1 service nova] Creating event network-changed:aba57bc8-f015-482d-bb33-afc7061216d5 for instance dca07e45-698f-4d2f-a558-62b184be9228 on hv-cinder-83699 May 09 20:36:11.150328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-0dacb6ea-9fe9-4a00-9ada-9cf7e4a33f39 req-18c5af64-8cea-4dec-9b35-c434669202b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056403 May 09 20:36:11.151372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 508/950] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:36:11.906864 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:11.907490 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:11.913743 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:11.914178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:11.914923 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:11.915976 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:12.061915 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:12.069333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3dd90b98-efdd-44de-be5d-6e9deb8f1982 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.166285 May 09 20:36:12.069895 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 443/951] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:11 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:13.086920 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:13.087616 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:13.094193 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:13.094690 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:13.095426 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:13.095869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:13.221959 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:13.229889 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-436a7bf8-0359-42ed-86a1-bac986885d07 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.147261 May 09 20:36:13.230464 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 509/952] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:13 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:14.247157 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:14.247813 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:14.254102 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:14.254545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:14.255300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:14.255756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:14.549200 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:14.557148 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-38cd708b-a8dc-45a5-ae91-81765f24fc4a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.313783 May 09 20:36:14.557704 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 444/953] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:14 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:15.573581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:15.574185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:15.580691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:15.581136 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:15.582340 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:15.582340 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:15.709527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:15.717753 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5912db59-3341-4f04-92ab-462daf14dde9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.148138 May 09 20:36:15.718303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 510/954] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:15 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:16.734630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:16.735337 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:16.743016 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:16.743703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:16.744561 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:16.745003 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:16.875548 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:16.882737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7883d5da-cd94-43d4-9b33-0f56b72736bf tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.151963 May 09 20:36:16.883276 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 445/955] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:16 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:17.899675 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:17.900401 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:17.906786 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:17.907233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:17.908023 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:17.908455 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:18.048167 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:18.055474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0a2a8d16-755c-496f-8d67-c8e22042f0ea tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.159579 May 09 20:36:18.056594 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 511/956] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:17 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:19.073444 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:19.074080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:19.079867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:19.080304 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:19.081057 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:19.081484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:19.205141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:19.212518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e2f692f5-adbe-4a7e-811b-602c82856cda tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.143565 May 09 20:36:19.213067 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 446/957] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:19 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:20.229096 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:20.229704 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:20.235956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:20.236401 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:20.237155 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:20.237585 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:20.363427 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:20.370775 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8922f29b-8fe3-46ed-b1de-90f1573d66e9 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.145485 May 09 20:36:20.371340 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 512/958] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:20 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:20.682065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-4b3727bf-377d-41f3-803b-8c5192b2f496 req-b4a2c3e5-aa07-4e1c-b0d6-48c1cfc65cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca07e45-698f-4d2f-a558-62b184be9228", "name": "network-vif-plugged", "status": "completed", "tag": "aba57bc8-f015-482d-bb33-afc7061216d5"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:36:20.689948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-4b3727bf-377d-41f3-803b-8c5192b2f496 req-b4a2c3e5-aa07-4e1c-b0d6-48c1cfc65cf0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:20.690384 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-4b3727bf-377d-41f3-803b-8c5192b2f496 req-b4a2c3e5-aa07-4e1c-b0d6-48c1cfc65cf0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:20.701572 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-4b3727bf-377d-41f3-803b-8c5192b2f496 req-b4a2c3e5-aa07-4e1c-b0d6-48c1cfc65cf0 service nova] Creating event network-vif-plugged:aba57bc8-f015-482d-bb33-afc7061216d5 for instance dca07e45-698f-4d2f-a558-62b184be9228 on hv-cinder-83699 May 09 20:36:20.707506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-4b3727bf-377d-41f3-803b-8c5192b2f496 req-b4a2c3e5-aa07-4e1c-b0d6-48c1cfc65cf0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150823 May 09 20:36:20.708056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 447/959] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:36:21.387787 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:21.388308 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:21.394543 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:21.394983 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:21.395762 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:21.396190 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:21.526369 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:21.533549 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-01f2761d-2d14-4e2e-b24f-f2a0baa90ace tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.150046 May 09 20:36:21.534106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 513/960] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:21 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:22.552350 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:22.553054 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:22.559799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:22.560243 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:22.560998 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:22.561430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:22.689414 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:22.702154 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5013194a-ef58-4775-9dcb-6134a25c584a tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1314 microversion: 2.1 time: 0.154369 May 09 20:36:22.702723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 448/961] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:22 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:23.720128 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:23.720706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:23.727049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:23.727693 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:23.728532 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:23.728971 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:23.855141 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:23.862365 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2fd1a458-c8df-4480-8918-88690dd4399f tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1463 microversion: 2.1 time: 0.146115 May 09 20:36:23.862924 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 514/962] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:23 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:23.901481 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:23.902007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:23.908507 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:23.908946 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:23.909688 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:23.910113 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:23.935018 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:36:24.007594 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-036de211-b02d-41bc-9fed-ac3f34d0f07d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 204 len: 0 microversion: 2.1 time: 0.109507 May 09 20:36:24.008263 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 449/963] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:36:23 2022] DELETE /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:36:24.016413 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:24.017027 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:24.022783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:24.023255 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:24.024043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:24.024766 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:24.148923 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:24.156210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9138dffb-7a12-461a-bd03-fdc5be4bb798 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1469 microversion: 2.1 time: 0.143569 May 09 20:36:24.156763 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 515/964] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:24 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1469 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:36:25.174757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:25.176605 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:25.182607 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:25.183054 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:25.183850 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:25.184282 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:25.307717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:36:25.307955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:36:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 (ip 10.222.0.44) !!! May 09 20:36:25.316642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:25.324770 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-beace658-af3a-4592-a011-e59da431b4c6 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1469 microversion: 2.1 time: 0.154269 May 09 20:36:25.325562 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 450/965] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:25 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:26.341858 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:26.342468 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:26.348872 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:26.349313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:26.350063 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:26.350486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:26.478958 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:26.486312 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-364852e8-b9da-46d9-8455-1e477b6a0916 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1469 microversion: 2.1 time: 0.148256 May 09 20:36:26.486940 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 516/966] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:26 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:27.503540 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:27.504154 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:27.511179 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:27.511656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:27.512426 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:27.512861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:27.639564 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:27.647077 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0cda1ea1-bd7f-45b4-a219-8e8083d21f6d tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1469 microversion: 2.1 time: 0.147303 May 09 20:36:27.647685 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 451/967] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:27 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:28.666051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:28.666663 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:28.673017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:28.673455 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:28.674205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:28.674630 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:28.800416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:28.807785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-df3605f0-035e-4767-ac45-f924a79199be tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1469 microversion: 2.1 time: 0.146333 May 09 20:36:28.808344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 517/968] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:28 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:29.575468 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-8655efac-721f-4dde-a50a-0fe5c2c422d5 req-72c6cd95-3927-45ab-b0e3-9152b5e9f5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca07e45-698f-4d2f-a558-62b184be9228", "name": "network-vif-deleted", "tag": "aba57bc8-f015-482d-bb33-afc7061216d5"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:36:29.584676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-8655efac-721f-4dde-a50a-0fe5c2c422d5 req-72c6cd95-3927-45ab-b0e3-9152b5e9f5bc service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:29.585121 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-8655efac-721f-4dde-a50a-0fe5c2c422d5 req-72c6cd95-3927-45ab-b0e3-9152b5e9f5bc service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:29.597484 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-8655efac-721f-4dde-a50a-0fe5c2c422d5 req-72c6cd95-3927-45ab-b0e3-9152b5e9f5bc service nova] Creating event network-vif-deleted:aba57bc8-f015-482d-bb33-afc7061216d5 for instance dca07e45-698f-4d2f-a558-62b184be9228 on hv-cinder-83699 May 09 20:36:29.603493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-8655efac-721f-4dde-a50a-0fe5c2c422d5 req-72c6cd95-3927-45ab-b0e3-9152b5e9f5bc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 May 09 20:36:29.604262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 452/969] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:36:29.824489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:29.825002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:29.831433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:29.831878 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:29.832628 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:29.833053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:29.862874 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:29.863304 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:29.863769 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lazy-loading 'fault' on Instance uuid dca07e45-698f-4d2f-a558-62b184be9228 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:36:29.906931 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d362ab9e847f281d212a8b5b630a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2236bae25a403e87f16039620cac17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:36:29.914106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3547d2a0-bf6a-4877-8496-5374561e8e27 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 200 len: 1304 microversion: 2.1 time: 0.093712 May 09 20:36:29.914687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 518/970] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:29 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:36:30.933022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:36:30.933717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] [instance: dca07e45-698f-4d2f-a558-62b184be9228] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:36:30.939771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:30.940207 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:30.940953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:36:30.941379 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:36:30.954187 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] HTTP exception thrown: Instance dca07e45-698f-4d2f-a558-62b184be9228 could not be found. May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Request method failure captured: May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 HTTP/1.1 May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXs1vVWtW5QEfpypwyCHglR4MbXxknfY1-h3HF8Xrt0g5snvkvhsyTtCdIoqu8GUx9ZBZVTcCEMWnSdGNeltKRPNnGjN7duiMZ7DqL9bfMFMBOvYDE0ansiIQgM5-PhJlXPdozC5RYkleYJTHtSKeeEpTCVnHfI_szCN6N29yT2y4Jk May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 5c2236bae25a403e87f16039620cac17 May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-VolumesNegativeTest-673419871 May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:36:30.955855 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5c2236bae25a403e87f16039620cac17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5c2236bae25a403e87f16039620cac17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5c2236bae25a403e87f16039620cac17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5c2236bae25a403e87f16039620cac17"}]}] May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-VolumesNegativeTest-673419871 May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 5c2236bae25a403e87f16039620cac17 May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-VolumesNegativeTest-673419871 May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-VolumesNegativeTest-673419871-project May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 925d362ab9e847f281d212a8b5b630a4 May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-VolumesNegativeTest-673419871-project May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance dca07e45-698f-4d2f-a558-62b184be9228 could not be found. May 09 20:36:30.957488 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': 'dca07e45-698f-4d2f-a558-62b184be9228'} May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca07e45-698f-4d2f-a558-62b184be9228 could not be found. May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:36:30.958342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca07e45-698f-4d2f-a558-62b184be9228 could not be found. May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca07e45-698f-4d2f-a558-62b184be9228 could not be found. May 09 20:36:30.959733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:36:30.960968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] Returning 404 to user: Instance dca07e45-698f-4d2f-a558-62b184be9228 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:36:30.960968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e62f4480-b751-4f81-bf94-98ff6850a909 tempest-VolumesNegativeTest-673419871 tempest-VolumesNegativeTest-673419871-project] 10.222.0.44 "GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228" status: 404 len: 111 microversion: 2.1 time: 0.029637 May 09 20:36:30.960968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 453/971] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:36:30 2022] GET /compute/v2.1/servers/dca07e45-698f-4d2f-a558-62b184be9228 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:36:45.874037 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c5e89046-448a-445e-b9c3-9db144714789 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Action: 'create', calling method: .version_select at 0x7f62bd2a9820>, body: {"keypair": {"name": "tempest-TestShelveInstance-808844846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQHH4OdOoRBgVbJYk6/Bq+y6/RYaIQGi3ckdSs0p9BUbOz/80PIFeYLr1TKaQqawcLr7er1LXE3cVKQKGJFKZe9HElQ28wHOhL3LM0eZOW9Pg92GwP3N6zozdZLu45s/Q=="}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:36:45.900870 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-c5e89046-448a-445e-b9c3-9db144714789 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Getting quotas for project 5e23dd64fa8645c3a4ced56a7c9c62df. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:36:45.912397 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-c5e89046-448a-445e-b9c3-9db144714789 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Getting quotas for user a408358ce1ea44a1ad62c41ebadd841d and project 5e23dd64fa8645c3a4ced56a7c9c62df. Resources: {'key_pairs'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:36:45.941143 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c5e89046-448a-445e-b9c3-9db144714789 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.243678 May 09 20:36:45.942026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 519/972] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:36:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:09.519620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-655052010", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-808844846", "security_groups": [{"name": "tempest-secgroup-smoke-1074478828"}], "networks": [{"uuid": "41da8f26-8b1d-486c-8af5-e07a660d2883"}], "block_device_mapping_v2": [{"uuid": "e24d32a4-e96e-4fad-8d9a-c72e233b9cad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:09.658381 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] validate_networks() for [('41da8f26-8b1d-486c-8af5-e07a660d2883', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:37:10.306443 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:37:10.307089 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:37:10.307797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:37:10.308613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:37:10.309229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:37:10.324411 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:10.325167 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:10.326237 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:10.326866 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:10.356920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Getting quotas for project 5e23dd64fa8645c3a4ced56a7c9c62df. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:37:10.361567 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Getting quotas for user a408358ce1ea44a1ad62c41ebadd841d and project 5e23dd64fa8645c3a4ced56a7c9c62df. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:37:10.448073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:37:10.450508 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e24d32a4-e96e-4fad-8d9a-c72e233b9cad',volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:37:10.628929 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-55c534a4-d3cf-4ce6-8d51-73f3b5f7b804 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.114228 May 09 20:37:10.632776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 454/973] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:37:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:37:10.643708 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c00479d1-ad09-4633-8403-0a76eff0c014 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:10.645080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c00479d1-ad09-4633-8403-0a76eff0c014 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:10.733623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-c00479d1-ad09-4633-8403-0a76eff0c014 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:10.742592 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c00479d1-ad09-4633-8403-0a76eff0c014 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1087 microversion: 2.1 time: 0.103489 May 09 20:37:10.748190 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 520/974] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:10 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1087 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:11.760784 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:11.762106 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:11.772187 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:11.773011 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:11.774781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:11.775372 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:11.866832 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:11.875883 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-79de7f3b-0525-40c5-ae56-4bc106a0da3f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1193 microversion: 2.1 time: 0.119490 May 09 20:37:11.887869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 455/975] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:11 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:12.893956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:12.894562 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:12.905321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:12.906134 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:12.907510 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:12.908165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:13.187684 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:13.196885 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4c28fef9-f860-4714-8fe2-c833e80e2e9d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.306001 May 09 20:37:13.212232 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 521/976] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:12 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:13.783622 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-2e82096c-015b-4b75-b293-c1cf75209f5c req-3c4e7a2c-67c9-4963-ae24-22d3751f544a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98279b96-77a7-48f1-aa77-551fff59ba77", "tag": "51968c87-09bb-44c3-835b-415f60941765"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:13.827372 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-2e82096c-015b-4b75-b293-c1cf75209f5c req-3c4e7a2c-67c9-4963-ae24-22d3751f544a service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:13.831607 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-2e82096c-015b-4b75-b293-c1cf75209f5c req-3c4e7a2c-67c9-4963-ae24-22d3751f544a service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:13.857948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-2e82096c-015b-4b75-b293-c1cf75209f5c req-3c4e7a2c-67c9-4963-ae24-22d3751f544a service nova] Creating event network-changed:51968c87-09bb-44c3-835b-415f60941765 for instance 98279b96-77a7-48f1-aa77-551fff59ba77 on hv-cinder-83699 May 09 20:37:13.871210 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-2e82096c-015b-4b75-b293-c1cf75209f5c req-3c4e7a2c-67c9-4963-ae24-22d3751f544a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092057 May 09 20:37:13.872468 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 456/977] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:14.219260 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:14.220512 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:14.229447 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:14.230112 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:14.231106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:14.231772 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:14.481211 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:14.489470 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b29e1961-26b6-4acc-9cc4-881d39856893 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.274942 May 09 20:37:14.503307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 522/978] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:14 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:15.507259 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:15.508066 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:15.516374 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:15.516835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:15.517591 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:15.518024 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:15.690262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:15.712947 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7ca76120-ecfe-4ef7-b6c2-710185273d18 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.209397 May 09 20:37:15.722438 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 457/979] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:15 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:16.730247 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:16.731482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:16.740930 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:16.741678 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:16.743165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:16.743912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:17.054055 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:17.065401 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0e6b8528-ee74-4951-9d72-2cbc2cd96943 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.339177 May 09 20:37:17.066066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 523/980] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:16 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:18.083363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:18.084117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:18.091501 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:18.092193 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:18.093170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:18.093676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:18.247764 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:18.255384 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5811392e-1503-4029-8112-ade69b9d14d1 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.176037 May 09 20:37:18.256243 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 458/981] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:18 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:19.272551 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:19.275053 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:19.282090 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:19.282537 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:19.283492 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:19.284310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:19.419114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:19.426707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ee5cc07e-7e0b-4419-be15-de7fefe13b0d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.157967 May 09 20:37:19.427254 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 524/982] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:19 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:19.606452 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c5fb7424-7f33-455e-a441-f3af564c1b7d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Action: 'create', calling method: .version_select at 0x7f62bcaa03a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-116171131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcAzKaJ9SZOE32CCs3PY4ak3U9HleqY9VuP8ozcWFD5joGcml+Jt4eDkAAWv9lf04MmsKZQIIEpp4E1ieH0OnsN4cVu7KbdOupSgYOlFeNsV9b2unaGa6OEq9Am5RgFXA=="}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:19.619923 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-c5fb7424-7f33-455e-a441-f3af564c1b7d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Getting quotas for project 36dd3d47f0c54036a5821e6815744e22. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:37:19.623514 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-c5fb7424-7f33-455e-a441-f3af564c1b7d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Getting quotas for user 0022312a6d124579a4d627acbc27bc01 and project 36dd3d47f0c54036a5821e6815744e22. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:37:19.645935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c5fb7424-7f33-455e-a441-f3af564c1b7d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.043368 May 09 20:37:19.646498 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 459/983] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:37:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:19.692950 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1772245110", "imageRef": "003ff298-1592-4e71-9f3a-43566d1731c8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-116171131", "networks": [{"uuid": "bf6cf357-73bb-4b7f-b2e5-3064ede08aa7"}]}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:19.742973 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] validate_networks() for [('bf6cf357-73bb-4b7f-b2e5-3064ede08aa7', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:37:20.401626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:37:20.402127 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:37:20.402494 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:37:20.402923 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:37:20.403330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:37:20.411829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:20.412269 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:20.413060 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:20.413490 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:20.431663 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Getting quotas for project 36dd3d47f0c54036a5821e6815744e22. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:37:20.435533 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Getting quotas for user 0022312a6d124579a4d627acbc27bc01 and project 36dd3d47f0c54036a5821e6815744e22. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:37:20.443552 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:20.444738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:20.448577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:37:20.449991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:20.450437 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:20.450776 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='003ff298-1592-4e71-9f3a-43566d1731c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:37:20.451201 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:20.451662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:20.502528 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1e764ce7-9486-4cf9-a309-296a0924abd9 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813160 May 09 20:37:20.503228 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 525/984] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:37:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:37:20.512910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-593dd71e-ed6b-4484-81af-00a146df78f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:20.513534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-593dd71e-ed6b-4484-81af-00a146df78f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:20.576428 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-593dd71e-ed6b-4484-81af-00a146df78f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:20.583822 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-593dd71e-ed6b-4484-81af-00a146df78f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1258 microversion: 2.1 time: 0.074904 May 09 20:37:20.584584 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 526/985] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:20 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:20.595181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:20.603712 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ec212c30-63df-40c1-a95b-1ad1ebe4a2d6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.163581 May 09 20:37:20.604021 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 460/986] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:20 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:21.601337 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:21.602586 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:21.608965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:21.609411 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:21.610173 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:21.610607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:21.620089 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:21.620703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:21.627776 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:21.628218 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:21.628978 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:21.629402 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:21.670977 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:21.678084 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-35f9ce61-3ae9-4d17-87d3-f64830f3385c tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1262 microversion: 2.1 time: 0.080601 May 09 20:37:21.678653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 527/987] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:21 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:21.758135 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:21.765646 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6bd2644c-b507-4e1e-a39e-af9b0fa004d3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.149361 May 09 20:37:21.766330 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 461/988] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:21 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:22.697545 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:22.698964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:22.707257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:22.708029 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:22.709191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:22.709848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:22.782517 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:22.783904 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:22.793131 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:22.801564 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-993402bb-24c9-4260-be67-84ec59adadf4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1316 microversion: 2.1 time: 0.109519 May 09 20:37:22.805854 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:22.815930 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 528/989] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:22 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1316 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:22.816928 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:22.817688 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:22.826064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:23.135915 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:23.156915 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d98bfc4a-3874-49c1-acf9-13fed4132a3e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.374158 May 09 20:37:23.158757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 462/990] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:22 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:23.823937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:23.824688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:23.830973 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:23.831434 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:23.832271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:23.832645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:23.969582 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:23.983555 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e0c37551-341f-4fee-902d-309f3784bb5b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.164019 May 09 20:37:23.984129 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 529/991] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:23 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:24.175121 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:24.175700 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:24.182926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:24.183378 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:24.184211 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:24.184661 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:24.331957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:24.339722 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6694c5a6-8105-439b-b8d3-ac4fca07c668 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.168417 May 09 20:37:24.340300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 463/992] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:24 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:25.001303 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:25.002666 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:25.010696 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:25.011358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:25.012226 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:25.012884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:25.158432 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:25.166698 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a807aa24-51d3-41ea-97f6-734bc75d1ad2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.169522 May 09 20:37:25.168628 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 530/993] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:24 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:25.357422 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:25.358297 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:25.364587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:25.365032 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:25.365799 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:25.366226 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:25.543717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:25.551506 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fa4bf555-315d-4f03-8731-bc7eeca1c64c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.198056 May 09 20:37:25.552420 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 464/994] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:25 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:26.191088 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:26.191736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:26.199671 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:26.200128 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:26.200949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:26.201341 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:26.340450 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:26.348069 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0530e91d-65cf-4ec8-941b-3e4ee65b7729 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.160734 May 09 20:37:26.348838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 531/995] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:26 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:26.609587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:26.610215 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:26.616697 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:26.617141 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:26.617957 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:26.618564 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:26.764886 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:26.773023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fca2efac-e46f-4524-b672-073a4cdddcc5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.175339 May 09 20:37:26.781790 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 465/996] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:26 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:27.361733 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-d6ef1d9a-d58d-4ec5-88df-90339765215f req-9eceb418-b82d-4bb4-a113-848132461855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98279b96-77a7-48f1-aa77-551fff59ba77", "name": "network-vif-plugged", "status": "completed", "tag": "51968c87-09bb-44c3-835b-415f60941765"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:27.368273 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:27.369335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:27.371330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-d6ef1d9a-d58d-4ec5-88df-90339765215f req-9eceb418-b82d-4bb4-a113-848132461855 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:27.372090 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-d6ef1d9a-d58d-4ec5-88df-90339765215f req-9eceb418-b82d-4bb4-a113-848132461855 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:27.379950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:27.380401 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:27.381175 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:27.381608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:27.383967 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-d6ef1d9a-d58d-4ec5-88df-90339765215f req-9eceb418-b82d-4bb4-a113-848132461855 service nova] Creating event network-vif-plugged:51968c87-09bb-44c3-835b-415f60941765 for instance 98279b96-77a7-48f1-aa77-551fff59ba77 on hv-cinder-83699 May 09 20:37:27.389436 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-d6ef1d9a-d58d-4ec5-88df-90339765215f req-9eceb418-b82d-4bb4-a113-848132461855 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032135 May 09 20:37:27.390114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 532/997] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:37:27.537693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:27.545728 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4ad25e4a-4211-4ab7-a5bf-4a1c00317c87 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.184683 May 09 20:37:27.556625 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 466/998] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:27 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:37:27.791228 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:27.791960 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:27.798093 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:27.798535 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:27.799292 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:27.799755 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:27.940121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:27.948449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4bb7e3d3-248c-4837-a225-39a9ba9796f3 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.161999 May 09 20:37:27.954722 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 533/999] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:27 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:28.563087 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:28.563730 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:28.570458 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:28.570936 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:28.571849 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:28.572331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:28.714268 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:28.722538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d2ef675d-7001-4442-81b5-8326fd08cacd tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.163186 May 09 20:37:28.724665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 467/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:28 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:28.965906 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:28.966949 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:28.974019 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:28.974468 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:28.975382 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:28.975843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:29.112709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:29.121253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6dc8f519-bc2c-47e4-98d8-852bd79fc80c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.159456 May 09 20:37:29.129749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 534/1001] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:28 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:29.740563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:29.741309 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:29.747982 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:29.748424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:29.749247 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:29.749680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:29.896912 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:29.905803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c5c809c6-b7a8-43ec-88cc-5d28e22d793d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.169062 May 09 20:37:29.906907 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 468/1002] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:29 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:30.138918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:30.139523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:30.145703 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:30.146151 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:30.146921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:30.147357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:30.284795 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:30.292345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1bf5f7e3-d315-4ed7-aa83-ffa5c9308378 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.157585 May 09 20:37:30.292904 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 535/1003] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:30 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:30.924264 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:30.924841 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:30.931793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:30.932238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:30.932996 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:30.933428 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:31.059932 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:31.067387 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0b7573b7-04a1-49d8-adae-b6e519cf3965 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.147082 May 09 20:37:31.067958 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 469/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:30 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:31.309899 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:31.310503 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:31.316851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:31.317298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:31.318054 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:31.318476 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:31.450353 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:31.457872 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-870c11d7-552e-4007-a5fd-1c9a467f15ce tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.151979 May 09 20:37:31.458423 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 536/1005] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:31 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:32.084850 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:32.085587 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:32.092499 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:32.092945 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:32.093702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:32.094129 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:32.216935 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:32.224325 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-151f19ca-2b10-4ccf-8987-557c856430e8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.143380 May 09 20:37:32.224881 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 470/1006] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:32 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:32.474773 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:32.475389 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:32.481935 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:32.482383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:32.483145 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:32.483608 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:32.613964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:32.621909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fa3aefa7-0a21-40fd-bae9-891796b8c3af tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.150962 May 09 20:37:32.622467 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 537/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:32 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:33.243006 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:33.243919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:33.251734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:33.252612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:33.253549 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:33.254233 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:33.449551 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:33.456797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fde39680-1724-4321-9db7-4833da353650 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.218510 May 09 20:37:33.457470 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 471/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:33 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:33.528018 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-b882ba9c-1f89-49d8-9b3b-2965de3ee85c req-c806747c-e3f5-423a-bee2-e089009ffda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbc9ce1-d727-4dfb-ad9c-6a2636762310", "tag": "0785fcc2-ef3b-4bfa-8a12-c90edb654d3d"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:33.537130 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b882ba9c-1f89-49d8-9b3b-2965de3ee85c req-c806747c-e3f5-423a-bee2-e089009ffda5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:33.537599 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-b882ba9c-1f89-49d8-9b3b-2965de3ee85c req-c806747c-e3f5-423a-bee2-e089009ffda5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:33.551679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-b882ba9c-1f89-49d8-9b3b-2965de3ee85c req-c806747c-e3f5-423a-bee2-e089009ffda5 service nova] Creating event network-changed:0785fcc2-ef3b-4bfa-8a12-c90edb654d3d for instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 on hv-cinder-83699 May 09 20:37:33.557313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-b882ba9c-1f89-49d8-9b3b-2965de3ee85c req-c806747c-e3f5-423a-bee2-e089009ffda5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034488 May 09 20:37:33.557908 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 538/1009] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:33.639176 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:33.639946 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:33.645981 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:33.646493 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:33.647470 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:33.647905 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:33.781780 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:33.789051 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-dec59371-3432-45d5-b7a6-7f70044ca00b tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1259 microversion: 2.1 time: 0.154036 May 09 20:37:33.789605 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 472/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:33 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:34.474886 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:34.475625 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:34.482190 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:34.482634 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:34.483387 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:34.483849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:34.613974 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:34.621785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2ae080b9-d111-4a79-9d32-33ed5603f1a7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.151091 May 09 20:37:34.622336 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 539/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:34 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:34.805789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:34.806526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:34.812955 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:34.813397 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:34.814163 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:34.814595 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:35.031166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:35.040292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cce12622-5c4f-44d2-9f0f-bf7ca0c0287d tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1444 microversion: 2.1 time: 0.238314 May 09 20:37:35.041002 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 473/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:34 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1444 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:35.056513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:35.057221 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:35.063007 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:35.063480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:35.064240 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:35.064673 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:35.193709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:35.201647 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-384ca9a5-b6af-4a25-81ba-7fe0442fe976 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1444 microversion: 2.1 time: 0.149181 May 09 20:37:35.202195 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 540/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:35 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:35.638612 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:35.639379 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:35.645228 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:35.645748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:35.646573 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:35.647092 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:35.777389 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:35.784731 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-599b4d9f-b8f5-415e-b799-7afa67b1da9e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.150338 May 09 20:37:35.794284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 474/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:35 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:36.801803 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:36.802409 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:36.808817 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:36.809265 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:36.810026 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:36.810454 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:37.019278 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:37.027008 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-cc679b4a-6c99-418d-9fb9-827057defd31 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.228993 May 09 20:37:37.027610 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 541/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:36 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:37.130839 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-5ceb268c-2901-4184-8623-97cbfe2812eb req-eac7c5be-6239-44b9-878d-6a6abb8016d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98279b96-77a7-48f1-aa77-551fff59ba77", "tag": "51968c87-09bb-44c3-835b-415f60941765"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:37.140533 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-5ceb268c-2901-4184-8623-97cbfe2812eb req-eac7c5be-6239-44b9-878d-6a6abb8016d6 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:37.140972 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-5ceb268c-2901-4184-8623-97cbfe2812eb req-eac7c5be-6239-44b9-878d-6a6abb8016d6 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:37.152892 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-5ceb268c-2901-4184-8623-97cbfe2812eb req-eac7c5be-6239-44b9-878d-6a6abb8016d6 service nova] Creating event network-changed:51968c87-09bb-44c3-835b-415f60941765 for instance 98279b96-77a7-48f1-aa77-551fff59ba77 on hv-cinder-83699 May 09 20:37:37.158257 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-5ceb268c-2901-4184-8623-97cbfe2812eb req-eac7c5be-6239-44b9-878d-6a6abb8016d6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154496 May 09 20:37:37.159118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 475/1016] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:37:38.044735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:38.045476 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:38.051847 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:38.052577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:38.053344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:38.053775 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:38.202629 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:38.210778 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-50ba719c-8f0e-43ab-8cdd-abc6c5c06cac tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.170150 May 09 20:37:38.212072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 542/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:38 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:39.229490 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:39.230191 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:39.236385 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:39.236838 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:39.237613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:39.238048 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:39.368020 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:39.375261 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ef497031-e786-48a8-95db-4e1df08c5796 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.150579 May 09 20:37:39.375842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 476/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:39 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:40.393174 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:40.393736 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:40.401241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:40.401699 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:40.402477 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:40.402913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:40.533579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:40.541356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5c403c6a-bcdc-4a60-be94-7a2ed018506b tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.152171 May 09 20:37:40.541901 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 543/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:40 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:41.377192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-c5a9098d-24d5-499e-ae44-af805c3b820a req-b4c3e04c-1d42-4add-8663-88e874d019d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cbc9ce1-d727-4dfb-ad9c-6a2636762310", "name": "network-vif-plugged", "status": "completed", "tag": "0785fcc2-ef3b-4bfa-8a12-c90edb654d3d"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:41.386000 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-c5a9098d-24d5-499e-ae44-af805c3b820a req-b4c3e04c-1d42-4add-8663-88e874d019d5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:41.386436 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-c5a9098d-24d5-499e-ae44-af805c3b820a req-b4c3e04c-1d42-4add-8663-88e874d019d5 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:41.398536 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-c5a9098d-24d5-499e-ae44-af805c3b820a req-b4c3e04c-1d42-4add-8663-88e874d019d5 service nova] Creating event network-vif-plugged:0785fcc2-ef3b-4bfa-8a12-c90edb654d3d for instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 on hv-cinder-83699 May 09 20:37:41.403608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-c5a9098d-24d5-499e-ae44-af805c3b820a req-b4c3e04c-1d42-4add-8663-88e874d019d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029986 May 09 20:37:41.404185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 477/1020] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:41.558423 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:41.558995 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:41.567057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:41.567057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:41.567057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:41.567057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:41.693662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:41.700782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fdf8903a-9b14-4be3-9a2d-041b3b014563 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.146574 May 09 20:37:41.701328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 544/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:41 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:42.718312 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:42.719024 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:42.725550 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:42.725999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:42.727007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:42.727476 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:42.856360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:42.863659 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-249124e3-69d5-4f3c-b0bd-5df310daf218 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1358 microversion: 2.1 time: 0.149484 May 09 20:37:42.864230 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 478/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:42 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:43.881101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:43.881663 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:43.888406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:43.888852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:43.889622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:43.890051 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:44.018403 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:44.026437 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-202d3dfc-44bc-4b4f-9910-5b0d3bac21ea tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1549 microversion: 2.1 time: 0.149260 May 09 20:37:44.026990 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 545/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:43 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:44.042864 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:44.043511 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:44.049676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:44.050118 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:44.050874 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:44.051304 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:44.179835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:44.187100 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-188e0f85-5f7a-4564-907a-6992093018a8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1549 microversion: 2.1 time: 0.148573 May 09 20:37:44.187680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 479/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:44 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:44.203577 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:44.207280 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:44.208080 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Searching by: {'deleted': False, 'project_id': '36dd3d47f0c54036a5821e6815744e22'} {{(pid=116849) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 09 20:37:44.215241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:44.215714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:44.216504 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:44.216934 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:44.305942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.multi_cell_list [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 09 20:37:44.395313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8d426855-3572-419e-97de-0151ca46a274 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.195418 May 09 20:37:44.395891 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 546/1025] 10.222.0.44 () {58 vars in 1124 bytes} [Mon May 9 20:37:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:44.406544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:44.407159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:44.413035 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:44.413415 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:44.414164 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:44.414589 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:44.538632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:44.553167 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cbb571a7-91e6-448e-8ad6-750b0fce65c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1549 microversion: 2.1 time: 0.150409 May 09 20:37:44.553733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 480/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:44 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:46.048860 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-bdb3e8c2-2371-4e5d-a220-9823d5f988c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95a7d05d-e223-4753-ba2b-f89f14143caa"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:46.049905 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-bdb3e8c2-2371-4e5d-a220-9823d5f988c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:46.056719 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bdb3e8c2-2371-4e5d-a220-9823d5f988c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:46.057157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bdb3e8c2-2371-4e5d-a220-9823d5f988c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:46.057903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bdb3e8c2-2371-4e5d-a220-9823d5f988c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:46.058330 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-bdb3e8c2-2371-4e5d-a220-9823d5f988c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:46.292158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-bdb3e8c2-2371-4e5d-a220-9823d5f988c6 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246975 May 09 20:37:46.292747 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 547/1027] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 20:37:46 2022] POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:52.961346 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:52.961961 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:52.967946 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:52.968393 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:52.969150 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:52.969585 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:53.101159 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:53.108967 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4bcf862c-2ab3-4479-a85b-c5e3e9aee490 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1595 microversion: 2.1 time: 0.153254 May 09 20:37:53.109518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 481/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:52 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:54.990794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-2984a162-473c-4ce0-ba46-3bc9a07a439f req-6dae6db2-bbe6-41e9-b0bc-76e5bc2fe8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbc9ce1-d727-4dfb-ad9c-6a2636762310", "tag": "0785fcc2-ef3b-4bfa-8a12-c90edb654d3d"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:54.999714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-2984a162-473c-4ce0-ba46-3bc9a07a439f req-6dae6db2-bbe6-41e9-b0bc-76e5bc2fe8d9 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:55.000166 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-2984a162-473c-4ce0-ba46-3bc9a07a439f req-6dae6db2-bbe6-41e9-b0bc-76e5bc2fe8d9 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:55.013074 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-2984a162-473c-4ce0-ba46-3bc9a07a439f req-6dae6db2-bbe6-41e9-b0bc-76e5bc2fe8d9 service nova] Creating event network-changed:0785fcc2-ef3b-4bfa-8a12-c90edb654d3d for instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 on hv-cinder-83699 May 09 20:37:55.018164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-2984a162-473c-4ce0-ba46-3bc9a07a439f req-6dae6db2-bbe6-41e9-b0bc-76e5bc2fe8d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032229 May 09 20:37:55.019165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 548/1029] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:37:56.044697 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-25177301"}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:56.045280 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:56.051735 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:56.052183 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:56.052953 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:56.053387 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:56.184757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.network.security_group_api [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Adding security group 5929e268-c473-48a8-8e9e-d454591d4087 to port 0785fcc2-ef3b-4bfa-8a12-c90edb654d3d May 09 20:37:56.527790 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f0da4dc5-4af5-45d4-a1e7-bb1c440a953e tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/action" status: 202 len: 0 microversion: 2.1 time: 0.487436 May 09 20:37:56.529487 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 482/1030] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:37:56 2022] POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:37:56.537872 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:37:56.539124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:37:56.545607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:56.546142 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:56.546975 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:56.547507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:56.708431 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:37:56.716489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1decf81f-ba3a-41d5-bfe1-466842aead51 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1758 microversion: 2.1 time: 0.183325 May 09 20:37:56.717327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 549/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:37:56 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:37:57.032421 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-db6730f5-f8c1-4b4e-83d9-09196e431c93 req-57bff95f-51e2-460b-89fe-80763b932238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbc9ce1-d727-4dfb-ad9c-6a2636762310", "tag": "0785fcc2-ef3b-4bfa-8a12-c90edb654d3d"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:37:57.040825 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-db6730f5-f8c1-4b4e-83d9-09196e431c93 req-57bff95f-51e2-460b-89fe-80763b932238 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:37:57.041195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-db6730f5-f8c1-4b4e-83d9-09196e431c93 req-57bff95f-51e2-460b-89fe-80763b932238 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:37:57.052607 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-db6730f5-f8c1-4b4e-83d9-09196e431c93 req-57bff95f-51e2-460b-89fe-80763b932238 service nova] Creating event network-changed:0785fcc2-ef3b-4bfa-8a12-c90edb654d3d for instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 on hv-cinder-83699 May 09 20:37:57.058435 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-db6730f5-f8c1-4b4e-83d9-09196e431c93 req-57bff95f-51e2-460b-89fe-80763b932238 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029666 May 09 20:37:57.059331 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 483/1032] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:38:57.430730 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f3da9e39-f445-4f39-8193-f54fd64d7ff3 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:38:57.432331 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f3da9e39-f445-4f39-8193-f54fd64d7ff3 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:38:57.438244 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3da9e39-f445-4f39-8193-f54fd64d7ff3 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:57.438695 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3da9e39-f445-4f39-8193-f54fd64d7ff3 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:38:57.439513 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3da9e39-f445-4f39-8193-f54fd64d7ff3 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:57.439954 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f3da9e39-f445-4f39-8193-f54fd64d7ff3 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:38:57.509639 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f3da9e39-f445-4f39-8193-f54fd64d7ff3 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/action" status: 202 len: 0 microversion: 2.1 time: 0.083775 May 09 20:38:57.510573 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 550/1033] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:38:57 2022] POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:38:57.521115 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:38:57.521824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:38:57.528713 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:57.529156 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:38:57.530706 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:57.531162 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:38:57.771757 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:38:57.779717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-169e1014-d085-46c7-8446-4a5718b10d9d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1750 microversion: 2.1 time: 0.264787 May 09 20:38:57.780275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 484/1034] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:38:57 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1750 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:38:58.799106 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:38:58.799837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:38:58.805909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:58.806977 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:38:58.807756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:58.808187 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:38:58.953523 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:38:58.961218 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-199a9ee9-af7e-4b83-9949-10fff116274f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.166902 May 09 20:38:58.961775 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 551/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:38:58 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:38:59.978064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:38:59.978665 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:38:59.984910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:59.985349 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:38:59.986097 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:38:59.986524 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:00.132576 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:00.141235 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-52041668-5802-48fb-a34b-9a61e258778f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.167172 May 09 20:39:00.141787 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 485/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:38:59 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:01.157833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:01.158474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:01.164768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:01.165231 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:01.166164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:01.166605 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:01.305710 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:01.314604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-da38edb3-6f08-49c6-aca2-c1bcaaa1ed4f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.160662 May 09 20:39:01.315179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 552/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:01 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:02.331812 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:02.332458 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:02.339217 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:02.339691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:02.340453 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:02.340885 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:02.495723 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:02.503376 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0517be80-ba7c-4b66-91a1-2e55e17bd27f tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.175418 May 09 20:39:02.503946 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 486/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:02 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:03.521152 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:03.521764 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:03.528245 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:03.528692 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:03.529450 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:03.529884 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:03.672163 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:03.680024 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-59f945d4-3992-4f5b-95ce-137ca670d0b2 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.162749 May 09 20:39:03.680586 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 553/1039] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:03 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:04.698344 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:04.698999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:04.705389 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:04.705841 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:04.706611 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:04.707047 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:04.844991 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:04.852962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-34dcb824-57b0-40a6-b696-879d08fcdb1d tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.159465 May 09 20:39:04.853511 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 487/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:04 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:05.870712 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:05.871264 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:05.877567 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:05.878022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:05.878789 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:05.879224 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:06.021520 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:06.029846 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-be6b34d6-fd35-480b-bfbb-efafbbb944f8 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.163775 May 09 20:39:06.030408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 554/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:05 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:07.047038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:07.047679 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:07.054007 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:07.054453 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:07.055249 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:07.056224 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:07.193616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:07.202229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-9552e1a2-a88a-425a-8cea-16688f820a30 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.158999 May 09 20:39:07.202781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 488/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:07 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:08.219527 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:08.220148 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:08.226345 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:08.226793 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:08.227581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:08.228017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:08.364688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:08.372896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-02369964-21a9-42c0-926f-9c555c7aa3b0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1755 microversion: 2.1 time: 0.157262 May 09 20:39:08.373459 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 555/1043] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:08 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:09.389630 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:09.390219 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:09.396497 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:09.396937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:09.397688 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:09.398119 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:09.539662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:09.547505 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-70b3396d-6158-4306-bcea-99442ee65e33 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1758 microversion: 2.1 time: 0.161844 May 09 20:39:09.548050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 489/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:09 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:30.859969 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:39:30.860557 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:39:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:39:40.722669 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:39:40.723287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:39:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:39:45.316229 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:39:45.316807 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:39:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:39:50.314248 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:39:50.314861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:39:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:39:54.239381 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:39:54.240022 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:54.246541 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:54.247010 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:54.247879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:54.248307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:54.270936 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.objects.instance [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lazy-loading 'flavor' on Instance uuid 98279b96-77a7-48f1-aa77-551fff59ba77 {{(pid=116849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:39:54.338685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ca081c54-32c0-471a-ba73-9386d933010e tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "POST /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77/action" status: 202 len: 0 microversion: 2.1 time: 0.103051 May 09 20:39:54.339284 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 556/1045] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:39:54 2022] POST /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:39:54.347803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:54.348416 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:54.354738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:54.355430 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:54.356121 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:54.356585 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:54.575515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:54.583435 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-49f41e52-c5fd-4a1e-8ace-1958d57170e5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.239677 May 09 20:39:54.583995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 490/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:54 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:55.602024 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:55.602756 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:55.608879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:55.609321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:55.610071 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:55.610504 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:55.794965 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:55.802414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2aecc1dd-2ea4-44a1-8b1a-785d8d11b277 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.205049 May 09 20:39:55.802964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 557/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:55 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:56.820116 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:56.820762 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:56.827727 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:56.828174 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:56.828937 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:56.829370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:56.958714 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:56.966789 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-84bf8360-eb5e-4053-a546-42e746d708a6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.150473 May 09 20:39:56.967617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 491/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:56 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:57.984718 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:57.985338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:57.991733 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:57.992185 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:57.992950 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:57.993388 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:58.121545 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:58.128781 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7527cbb5-da9d-412c-bbd2-d656b63c7b35 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.148006 May 09 20:39:58.129335 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 558/1049] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:57 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:39:59.146548 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:39:59.147164 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:39:59.153710 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:59.154160 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:59.154918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:39:59.155348 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:39:59.281715 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:39:59.289041 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-5abb81a8-a642-407a-bc84-53f72d1bcc16 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.146349 May 09 20:39:59.289728 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 492/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:39:59 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:00.306111 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:00.306714 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:00.313745 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:00.314191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:00.314950 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:00.315383 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:00.446433 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:00.456205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-37e732ba-343f-4444-a843-50c39899f0b0 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.153954 May 09 20:40:00.456774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 559/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:00 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:01.473933 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:01.474534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:01.481918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:01.482357 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:01.483112 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:01.483570 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:01.616337 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:01.623806 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a6206244-6f0b-49ac-8168-da497abcc063 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.153837 May 09 20:40:01.624351 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 493/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:01 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:02.641025 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:02.641638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:02.648165 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:02.648606 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:02.649360 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:02.649785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:02.775355 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:02.782785 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-96aa23ba-8d98-4bec-b343-5841760d0374 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.145624 May 09 20:40:02.783336 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 560/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:02 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:03.800004 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:03.800608 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:03.806827 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:03.807267 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:03.808050 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:03.809030 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:03.935690 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:03.942965 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cf9af2fa-8c4d-412e-ac26-934bacdf29bc tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.146805 May 09 20:40:03.943549 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 494/1054] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:03 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:04.961307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:04.962112 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:04.969919 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:04.970646 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:04.971753 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:04.972325 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:05.104890 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:05.112181 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-026ac94b-5ab9-42fe-b336-590d8abff0c2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.154815 May 09 20:40:05.112740 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 561/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:04 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:06.129188 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:06.129810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:06.136341 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:06.136824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:06.137668 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:06.138101 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:06.264406 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:06.271719 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-2caf627b-ac61-48be-bcea-a97c072e68ea tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.146317 May 09 20:40:06.272262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 495/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:06 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:40:07.290274 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:07.290887 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:07.297820 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:07.298271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:07.299054 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:07.299511 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:07.431241 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:07.438688 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1124a956-f41f-4aed-b97b-d17e4dd5413c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1510 microversion: 2.1 time: 0.152951 May 09 20:40:07.439237 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 562/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:07 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:07.455376 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-96835b51-8d21-4309-8911-2246f9329311 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:07.456049 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-96835b51-8d21-4309-8911-2246f9329311 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:07.462286 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96835b51-8d21-4309-8911-2246f9329311 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:07.462733 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96835b51-8d21-4309-8911-2246f9329311 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:07.463526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96835b51-8d21-4309-8911-2246f9329311 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:07.463962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-96835b51-8d21-4309-8911-2246f9329311 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:07.537431 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-96835b51-8d21-4309-8911-2246f9329311 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "POST /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77/action" status: 202 len: 0 microversion: 2.1 time: 0.085917 May 09 20:40:07.538023 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 496/1058] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:40:07 2022] POST /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:40:07.545979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:07.546611 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:07.552644 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:07.553160 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:07.553989 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:07.554425 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:07.687520 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:07.694794 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3a97cd60-3706-45ee-94b4-bfc0b2e9812f tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1518 microversion: 2.1 time: 0.152685 May 09 20:40:07.695350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 563/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:07 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:08.713114 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:08.713709 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:08.720736 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:08.721223 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:08.722000 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:08.722670 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:08.852486 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:08.860215 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a7a00a12-7b51-4925-af23-79c7dcbd130c tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.151421 May 09 20:40:08.860773 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 497/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:08 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:09.877651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:09.878178 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:09.884480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:09.885179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:09.885925 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:09.886358 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:10.012838 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-0907ec36-afec-492f-940d-d0e1efaa66e4 req-74206381-8a89-48be-9401-115be40ca5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98279b96-77a7-48f1-aa77-551fff59ba77", "name": "network-vif-unplugged", "status": "completed", "tag": "51968c87-09bb-44c3-835b-415f60941765"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:10.022580 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:10.023617 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-0907ec36-afec-492f-940d-d0e1efaa66e4 req-74206381-8a89-48be-9401-115be40ca5d4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:10.024323 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-0907ec36-afec-492f-940d-d0e1efaa66e4 req-74206381-8a89-48be-9401-115be40ca5d4 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:10.031276 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-4121795e-5f3b-4f8c-9053-13fe5cddd217 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.157487 May 09 20:40:10.037906 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-0907ec36-afec-492f-940d-d0e1efaa66e4 req-74206381-8a89-48be-9401-115be40ca5d4 service nova] Creating event network-vif-unplugged:51968c87-09bb-44c3-835b-415f60941765 for instance 98279b96-77a7-48f1-aa77-551fff59ba77 on hv-cinder-83699 May 09 20:40:10.042359 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 564/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:09 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:10.044200 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-0907ec36-afec-492f-940d-d0e1efaa66e4 req-74206381-8a89-48be-9401-115be40ca5d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035874 May 09 20:40:10.044869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 498/1062] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:40:11.048851 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:11.049499 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:11.055838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:11.056282 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:11.057040 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:11.057474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:11.185321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:11.192614 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3032f8ea-490c-458e-9ce2-c4993bc176ba tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.147660 May 09 20:40:11.193178 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 565/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:11 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:12.210784 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:12.211572 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:12.217775 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:12.218218 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:12.218973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:12.219416 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:12.348146 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:12.356128 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6c8c38f2-1f8a-41e0-b237-12eaad2cd532 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.149409 May 09 20:40:12.356687 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 499/1064] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:12 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:12.951161 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-25177301"}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:12.951691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:12.958136 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:12.958582 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:12.959342 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:12.959864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:13.087852 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.network.security_group_api [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Removing security group 5929e268-c473-48a8-8e9e-d454591d4087 from port 0785fcc2-ef3b-4bfa-8a12-c90edb654d3d May 09 20:40:13.372968 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:13.373693 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:13.380389 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:13.380835 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:13.381622 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:13.382053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:13.523975 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:13.533370 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-47fa398b-7202-414e-a4d9-e94a9c178309 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.164277 May 09 20:40:13.533930 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 500/1065] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:13 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:40:13.710050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-54231ce6-00bc-4b90-a432-adb626c01b61 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/action" status: 202 len: 0 microversion: 2.1 time: 0.762880 May 09 20:40:13.714127 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 566/1066] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 20:40:12 2022] POST /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:40:13.719683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-e3a26b1a-9041-4caa-a6f4-c3e384cd3797 req-3436a33f-7766-4d10-9376-fda9c3c73769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbc9ce1-d727-4dfb-ad9c-6a2636762310", "tag": "0785fcc2-ef3b-4bfa-8a12-c90edb654d3d"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:13.729037 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-e3a26b1a-9041-4caa-a6f4-c3e384cd3797 req-3436a33f-7766-4d10-9376-fda9c3c73769 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:13.729685 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-e3a26b1a-9041-4caa-a6f4-c3e384cd3797 req-3436a33f-7766-4d10-9376-fda9c3c73769 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:13.743185 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-e3a26b1a-9041-4caa-a6f4-c3e384cd3797 req-3436a33f-7766-4d10-9376-fda9c3c73769 service nova] Creating event network-changed:0785fcc2-ef3b-4bfa-8a12-c90edb654d3d for instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 on hv-cinder-83699 May 09 20:40:13.749503 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-e3a26b1a-9041-4caa-a6f4-c3e384cd3797 req-3436a33f-7766-4d10-9376-fda9c3c73769 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033489 May 09 20:40:13.750589 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 501/1067] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:40:14.551782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:14.552426 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:14.558715 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:14.559335 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:14.560881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:14.561314 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:14.786401 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:14.794921 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-67665a65-b254-4227-bf94-5f54c16c31ff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.247493 May 09 20:40:14.795503 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 567/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:14 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:15.012140 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:15.012811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:15.018969 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:15.019526 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:15.020367 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:15.020872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:15.103037 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lazy-loading 'services' on Instance uuid 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:40:15.175568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6c67e511-5f30-46c9-9f66-5e7cfa4b6ec5 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments/95a7d05d-e223-4753-ba2b-f89f14143caa" status: 202 len: 0 microversion: 2.1 time: 0.168691 May 09 20:40:15.176147 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 502/1069] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:40:15 2022] DELETE /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments/95a7d05d-e223-4753-ba2b-f89f14143caa => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:40:15.184987 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-39ef741a-5d0b-4fae-ba8a-965f4e12eba4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:15.186059 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-39ef741a-5d0b-4fae-ba8a-965f4e12eba4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:15.192114 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39ef741a-5d0b-4fae-ba8a-965f4e12eba4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:15.192631 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39ef741a-5d0b-4fae-ba8a-965f4e12eba4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:15.193623 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39ef741a-5d0b-4fae-ba8a-965f4e12eba4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:15.194105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39ef741a-5d0b-4fae-ba8a-965f4e12eba4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:15.226201 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-39ef741a-5d0b-4fae-ba8a-965f4e12eba4 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045608 May 09 20:40:15.226892 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 568/1070] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:40:15 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:40:15.770170 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-7ea9df5a-c5ac-4dcd-821e-7ac7358448d9 req-58a974cf-7403-4a72-95e1-70f50bc75983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbc9ce1-d727-4dfb-ad9c-6a2636762310", "tag": "0785fcc2-ef3b-4bfa-8a12-c90edb654d3d"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:15.779181 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-7ea9df5a-c5ac-4dcd-821e-7ac7358448d9 req-58a974cf-7403-4a72-95e1-70f50bc75983 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:15.779649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-7ea9df5a-c5ac-4dcd-821e-7ac7358448d9 req-58a974cf-7403-4a72-95e1-70f50bc75983 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:15.790453 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-7ea9df5a-c5ac-4dcd-821e-7ac7358448d9 req-58a974cf-7403-4a72-95e1-70f50bc75983 service nova] Creating event network-changed:0785fcc2-ef3b-4bfa-8a12-c90edb654d3d for instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 on hv-cinder-83699 May 09 20:40:15.796751 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-7ea9df5a-c5ac-4dcd-821e-7ac7358448d9 req-58a974cf-7403-4a72-95e1-70f50bc75983 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030591 May 09 20:40:15.797368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 503/1071] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:40:15.811289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:15.812074 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:15.818420 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:15.818943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:15.819732 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:15.820163 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:15.961735 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:15.971460 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e1bcdfe8-1044-4316-b86a-51319f579f34 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.164005 May 09 20:40:15.977257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 569/1072] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:15 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:16.239070 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-08b8a883-99f8-449f-944c-cf14677c9adf tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:16.240092 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-08b8a883-99f8-449f-944c-cf14677c9adf tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:16.246292 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-08b8a883-99f8-449f-944c-cf14677c9adf tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:16.246741 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-08b8a883-99f8-449f-944c-cf14677c9adf tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:16.247520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-08b8a883-99f8-449f-944c-cf14677c9adf tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:16.247954 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-08b8a883-99f8-449f-944c-cf14677c9adf tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:16.276447 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-08b8a883-99f8-449f-944c-cf14677c9adf tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 May 09 20:40:16.277585 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 504/1073] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:40:16 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:40:16.989666 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:16.990270 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:16.997457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:16.997896 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:16.998673 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:16.999090 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:17.137336 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:17.146101 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fd7b7198-d12a-4486-958d-bfeec0136fff tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.160165 May 09 20:40:17.146849 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 570/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:16 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:17.289123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-af2c2550-abe4-4a38-bc6f-163d62992747 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:17.290190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-af2c2550-abe4-4a38-bc6f-163d62992747 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:17.297270 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af2c2550-abe4-4a38-bc6f-163d62992747 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:17.297727 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af2c2550-abe4-4a38-bc6f-163d62992747 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:17.298504 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af2c2550-abe4-4a38-bc6f-163d62992747 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:17.299136 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-af2c2550-abe4-4a38-bc6f-163d62992747 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:17.329795 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-af2c2550-abe4-4a38-bc6f-163d62992747 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044974 May 09 20:40:17.330359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 505/1075] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 20:40:17 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 20:40:17.340809 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:17.341310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:17.347076 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:17.347570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:17.348343 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:17.348783 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:17.423760 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] HTTP exception thrown: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 is not attached to volume 95a7d05d-e223-4753-ba2b-f89f14143caa May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Request method failure captured: May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: DELETE /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments/95a7d05d-e223-4753-ba2b-f89f14143caa HTTP/1.1 May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXtwhVi18ycl3W0r5bTkXH6FCeH6Bc72j6RZb9XzMs9yFcZkITJ8PZyjOshgM_tANkwuONsxU81bjTDdgzqipHt2nh21o_Yki0VB8NN8IeaE95gLdKn-JzNyLk1fYW8YiY0Qrn7L64X0sJ83ZGoLksb03deJUt09-DKYSPbPBo4uW9g May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 36dd3d47f0c54036a5821e6815744e22 May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-TestMinimumBasicScenario-1308805186 May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:40:17.426362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36dd3d47f0c54036a5821e6815744e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36dd3d47f0c54036a5821e6815744e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36dd3d47f0c54036a5821e6815744e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36dd3d47f0c54036a5821e6815744e22"}]}] May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-TestMinimumBasicScenario-1308805186 May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 36dd3d47f0c54036a5821e6815744e22 May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1308805186 May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-TestMinimumBasicScenario-1308805186-project May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 0022312a6d124579a4d627acbc27bc01 May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-TestMinimumBasicScenario-1308805186-project May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:40:17.428105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 is not attached to volume 95a7d05d-e223-4753-ba2b-f89f14143caa May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'server_id': '2cbc9ce1-d727-4dfb-ad9c-6a2636762310', 'id': '95a7d05d-e223-4753-ba2b-f89f14143caa'} May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 95a7d05d-e223-4753-ba2b-f89f14143caa. May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:40:17.428978 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 is not attached to volume 95a7d05d-e223-4753-ba2b-f89f14143caa May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 is not attached to volume 95a7d05d-e223-4753-ba2b-f89f14143caa May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:40:17.430306 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Returning 404 to user: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 is not attached to volume 95a7d05d-e223-4753-ba2b-f89f14143caa {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:40:17.431302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-8b70e9d4-f1b6-4e86-93a6-0374675b1ff7 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments/95a7d05d-e223-4753-ba2b-f89f14143caa" status: 404 len: 154 microversion: 2.1 time: 0.091582 May 09 20:40:17.431796 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 571/1076] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 20:40:17 2022] DELETE /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310/os-volume_attachments/95a7d05d-e223-4753-ba2b-f89f14143caa => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:40:18.166417 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:18.167021 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:18.173353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:18.173788 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:18.174545 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:18.174976 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:18.562348 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:18.562962 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:18.569554 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:18.570002 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:18.570774 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:18.571203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:18.597251 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:18.598050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:40:18.604707 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3a1e503e-f733-4d23-a98c-f8770bd1b7da tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1576 microversion: 2.1 time: 0.442146 May 09 20:40:18.605353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 506/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:18 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1576 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:18.670883 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-61fdb05a-2e51-4ebb-8eee-2b63ab119715 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 204 len: 0 microversion: 2.1 time: 0.112193 May 09 20:40:18.671474 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 572/1078] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:40:18 2022] DELETE /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 20:40:18.679669 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:18.680503 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:18.686542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:18.687005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:18.687795 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:18.688226 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:18.820031 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:18.828138 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-a5958aa9-f063-4be3-80ac-4bd91a746be0 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1555 microversion: 2.1 time: 0.152414 May 09 20:40:18.828737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 507/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:18 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:19.622624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:19.623328 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:19.632348 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:19.633149 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:19.634778 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:19.635620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:19.764705 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:19.771964 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-7d45f021-5872-4373-9d96-f4e7d300f9c6 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1563 microversion: 2.1 time: 0.153576 May 09 20:40:19.772524 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 573/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:19 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:19.846039 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:19.846563 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:19.852823 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:19.853271 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:19.854032 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:19.854469 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:19.983275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:19.990578 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ac7ec716-aa5a-4970-9fda-e605879910fa tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1555 microversion: 2.1 time: 0.148538 May 09 20:40:19.991134 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 508/1081] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:19 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:20.277332 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-6455b8ea-6d19-41de-afa3-1f2b8703e2dc req-6329fa17-7e9d-40a5-9859-21081a9fb824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98279b96-77a7-48f1-aa77-551fff59ba77", "name": "network-vif-plugged", "status": "completed", "tag": "51968c87-09bb-44c3-835b-415f60941765"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:20.285706 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-6455b8ea-6d19-41de-afa3-1f2b8703e2dc req-6329fa17-7e9d-40a5-9859-21081a9fb824 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:20.286171 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-6455b8ea-6d19-41de-afa3-1f2b8703e2dc req-6329fa17-7e9d-40a5-9859-21081a9fb824 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:20.299942 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-6455b8ea-6d19-41de-afa3-1f2b8703e2dc req-6329fa17-7e9d-40a5-9859-21081a9fb824 service nova] Creating event network-vif-plugged:51968c87-09bb-44c3-835b-415f60941765 for instance 98279b96-77a7-48f1-aa77-551fff59ba77 on hv-cinder-83699 May 09 20:40:20.304757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-6455b8ea-6d19-41de-afa3-1f2b8703e2dc req-6329fa17-7e9d-40a5-9859-21081a9fb824 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 May 09 20:40:20.305595 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 574/1082] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:40:21.007950 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:21.008556 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:21.015640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:21.016125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:21.016888 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:21.017316 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:21.212642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022312a6d124579a4d627acbc27bc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36dd3d47f0c54036a5821e6815744e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:40:21.220364 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ad5bfa2e-fa51-4f3a-be27-c425d11f4417 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 200 len: 1555 microversion: 2.1 time: 0.216297 May 09 20:40:21.221139 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 509/1083] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:21 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:40:21.444991 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-d038ba0b-a063-4205-ae69-7e0e30102965 req-1ddcc92a-fa08-4d75-b49d-b6ab5447b9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cbc9ce1-d727-4dfb-ad9c-6a2636762310", "name": "network-vif-deleted", "tag": "0785fcc2-ef3b-4bfa-8a12-c90edb654d3d"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:21.454624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-d038ba0b-a063-4205-ae69-7e0e30102965 req-1ddcc92a-fa08-4d75-b49d-b6ab5447b9ce service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:21.455070 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-d038ba0b-a063-4205-ae69-7e0e30102965 req-1ddcc92a-fa08-4d75-b49d-b6ab5447b9ce service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:21.467069 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-d038ba0b-a063-4205-ae69-7e0e30102965 req-1ddcc92a-fa08-4d75-b49d-b6ab5447b9ce service nova] Creating event network-vif-deleted:0785fcc2-ef3b-4bfa-8a12-c90edb654d3d for instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 on hv-cinder-83699 May 09 20:40:21.471679 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-d038ba0b-a063-4205-ae69-7e0e30102965 req-1ddcc92a-fa08-4d75-b49d-b6ab5447b9ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094567 May 09 20:40:21.472257 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 575/1084] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:40:22.238886 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:22.239532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] [instance: 2cbc9ce1-d727-4dfb-ad9c-6a2636762310] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:40:22.246532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:22.246973 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:22.247769 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:40:22.248204 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:40:22.262525 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] HTTP exception thrown: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 could not be found. May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Request method failure captured: May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 HTTP/1.1 May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXtwhVi18ycl3W0r5bTkXH6FCeH6Bc72j6RZb9XzMs9yFcZkITJ8PZyjOshgM_tANkwuONsxU81bjTDdgzqipHt2nh21o_Yki0VB8NN8IeaE95gLdKn-JzNyLk1fYW8YiY0Qrn7L64X0sJ83ZGoLksb03deJUt09-DKYSPbPBo4uW9g May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: 36dd3d47f0c54036a5821e6815744e22 May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-TestMinimumBasicScenario-1308805186 May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:40:22.264177 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36dd3d47f0c54036a5821e6815744e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36dd3d47f0c54036a5821e6815744e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36dd3d47f0c54036a5821e6815744e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36dd3d47f0c54036a5821e6815744e22"}]}] May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-TestMinimumBasicScenario-1308805186 May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: 36dd3d47f0c54036a5821e6815744e22 May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1308805186 May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-TestMinimumBasicScenario-1308805186-project May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 0022312a6d124579a4d627acbc27bc01 May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-TestMinimumBasicScenario-1308805186-project May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 could not be found. May 09 20:40:22.265766 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '2cbc9ce1-d727-4dfb-ad9c-6a2636762310'} May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 could not be found. May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:40:22.266754 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 could not be found. May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 could not be found. May 09 20:40:22.268298 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:40:22.269691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Returning 404 to user: Instance 2cbc9ce1-d727-4dfb-ad9c-6a2636762310 could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:40:22.269691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8a352107-7285-49fc-83c8-1051e0a72e81 tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310" status: 404 len: 111 microversion: 2.1 time: 0.030551 May 09 20:40:22.269691 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 510/1085] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:40:22 2022] GET /compute/v2.1/servers/2cbc9ce1-d727-4dfb-ad9c-6a2636762310 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:40:22.274879 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f5f2cb20-866c-4015-87b0-7f6943734a6a tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] Calling method '.version_select at 0x7f62bd2a9dc0>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:40:22.296256 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f5f2cb20-866c-4015-87b0-7f6943734a6a tempest-TestMinimumBasicScenario-1308805186 tempest-TestMinimumBasicScenario-1308805186-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-116171131" status: 202 len: 0 microversion: 2.1 time: 0.025501 May 09 20:40:22.296882 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 576/1086] 10.222.0.44 () {58 vars in 1268 bytes} [Mon May 9 20:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-116171131 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:40:40.046184 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-aca5a513-a2ba-464f-ace7-521eedce1abb tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Action: 'create', calling method: .version_select at 0x7f62bcc14af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1619461407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNlD+XL7vl4x+oVUCK9QQ1721UFShfOYKktq32raWGOwUrA8kPlAvpWEZ3MQdX7gs+gWuYfXUbSOHIR+Jb3nSkdrlyg7AeX1CeU6wsDCFrsuHs/FP4sPrc1BdYx6/jTAA=="}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:40:40.060254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-aca5a513-a2ba-464f-ace7-521eedce1abb tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:40:40.064015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-aca5a513-a2ba-464f-ace7-521eedce1abb tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for user 95791a44989743338f7177fd8a2e434e and project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'key_pairs'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:40:40.093459 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-aca5a513-a2ba-464f-ace7-521eedce1abb tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.212490 May 09 20:40:40.094195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 511/1087] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 9 20:40:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:41:02.634722 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2065012406", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1619461407", "security_groups": [{"name": "tempest-secgroup-smoke-615297796"}], "block_device_mapping_v2": [{"uuid": "025f2a38-9c7e-4ec0-8fd8-308f582e8b5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e2ea1299-c317-41b1-b2f7-701f12287a92"}]}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:41:02.745539 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] validate_networks() for [('e2ea1299-c317-41b1-b2f7-701f12287a92', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:41:03.368728 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:41:03.369175 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:41:03.369643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:41:03.370048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:41:03.370453 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:41:03.379124 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:03.379608 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:03.380406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:03.380869 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:03.397933 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:41:03.401757 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for user 95791a44989743338f7177fd8a2e434e and project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:41:03.457071 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:41:03.459288 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='025f2a38-9c7e-4ec0-8fd8-308f582e8b5d',volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:41:03.588017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-ef9e9318-28db-416e-913a-ca4538af024c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.957475 May 09 20:41:03.588657 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 577/1088] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:41:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:41:03.600079 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-276dc72a-d57c-4bfc-bf06-58a08bd30484 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:03.600721 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-276dc72a-d57c-4bfc-bf06-58a08bd30484 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:03.657193 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-276dc72a-d57c-4bfc-bf06-58a08bd30484 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:03.663795 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-276dc72a-d57c-4bfc-bf06-58a08bd30484 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1095 microversion: 2.1 time: 0.068089 May 09 20:41:03.664361 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 512/1089] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:03 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:04.680920 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:04.681534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:04.688819 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:04.689278 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:04.690079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:04.690519 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:04.752065 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:04.759357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-dc3f80ae-ac40-4596-a728-6de0325a882b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1211 microversion: 2.1 time: 0.082378 May 09 20:41:04.764505 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 578/1090] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:04 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:05.778779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:05.779409 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:05.785824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:05.786303 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:05.787145 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:05.787662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:05.817364 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-1c1ffded-b2b7-4d33-8b55-2a597fa8b614 req-7e3be3e8-6d02-4a0d-b179-81d6cb968316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b41c8e0-e943-4df2-9c40-c6b3b9803cbe", "tag": "11da88c3-93de-46c0-8ab1-eea225f29510"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:41:05.833880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-1c1ffded-b2b7-4d33-8b55-2a597fa8b614 req-7e3be3e8-6d02-4a0d-b179-81d6cb968316 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:05.834605 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-1c1ffded-b2b7-4d33-8b55-2a597fa8b614 req-7e3be3e8-6d02-4a0d-b179-81d6cb968316 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:05.862696 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-1c1ffded-b2b7-4d33-8b55-2a597fa8b614 req-7e3be3e8-6d02-4a0d-b179-81d6cb968316 service nova] Creating event network-changed:11da88c3-93de-46c0-8ab1-eea225f29510 for instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe on hv-cinder-83699 May 09 20:41:05.869121 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-1c1ffded-b2b7-4d33-8b55-2a597fa8b614 req-7e3be3e8-6d02-4a0d-b179-81d6cb968316 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055421 May 09 20:41:05.869658 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 579/1091] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:41:06.038703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:06.046731 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-cb234308-2110-4c46-8c27-2e67369230e6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.271857 May 09 20:41:06.047473 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 513/1092] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:05 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:07.065207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:07.065916 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:07.072409 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:07.072856 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:07.073624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:07.074064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:07.203233 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:07.210553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a5a9d1de-6b7b-44ea-b151-cb9558c6285a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.149623 May 09 20:41:07.211115 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 580/1093] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:07 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:08.227502 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:08.228108 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:08.235046 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:08.235516 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:08.236279 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:08.236708 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:08.368434 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:08.375737 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fab3b8f2-b4e9-44ff-930b-07f2e7a924f0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.152159 May 09 20:41:08.376288 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 514/1094] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:08 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:09.393337 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:09.393937 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:09.400296 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:09.400739 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:09.401484 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:09.401911 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:09.532035 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:09.539253 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a00b91cf-b46a-4b8c-b5ee-2d572cc9c4b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.149760 May 09 20:41:09.539831 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 581/1095] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:09 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:10.555815 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:10.556391 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:10.562889 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:10.563335 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:10.564123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:10.564555 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:10.693948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:10.701142 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-992c0e04-77a6-4ac7-827e-63247357f744 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.149348 May 09 20:41:10.701692 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 515/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:10 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:11.717858 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:11.718479 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:11.724897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:11.725344 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:11.726109 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:11.726572 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:11.853656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:11.861392 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-9ed9fbd9-6f06-46be-badd-55f3fc0b3f7a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.147435 May 09 20:41:11.861952 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 582/1097] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:11 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:12.879067 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:12.879627 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:12.886441 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:12.886893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:12.887721 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:12.888999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:13.020318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:13.028724 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-dad131c3-1e06-4774-96ba-c4bfcb44d429 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.153736 May 09 20:41:13.029262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 516/1098] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:12 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:14.045709 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:14.046385 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:14.052640 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:14.053094 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:14.053859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:14.054298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:14.184486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:14.191701 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-d2d70e06-2818-4e0c-b46d-9dbf59761b85 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.150114 May 09 20:41:14.192261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 583/1099] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:14 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:15.208460 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:15.209061 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:15.215314 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:15.215788 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:15.216544 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:15.216970 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:15.344609 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:15.351791 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-82221164-41c7-433d-bf13-131b159bd035 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.147194 May 09 20:41:15.352568 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 517/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:15 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:16.369184 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:16.369912 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:16.376839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:16.377367 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:16.378158 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:16.378610 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:16.392584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-26d6af12-9569-423b-bd8f-2de5895f7cca req-24661890-0f1c-4b51-ad85-95ff643be60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41c8e0-e943-4df2-9c40-c6b3b9803cbe", "name": "network-vif-plugged", "status": "completed", "tag": "11da88c3-93de-46c0-8ab1-eea225f29510"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:41:16.402254 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-26d6af12-9569-423b-bd8f-2de5895f7cca req-24661890-0f1c-4b51-ad85-95ff643be60f service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:16.402532 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-26d6af12-9569-423b-bd8f-2de5895f7cca req-24661890-0f1c-4b51-ad85-95ff643be60f service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:16.416604 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-26d6af12-9569-423b-bd8f-2de5895f7cca req-24661890-0f1c-4b51-ad85-95ff643be60f service nova] Creating event network-vif-plugged:11da88c3-93de-46c0-8ab1-eea225f29510 for instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe on hv-cinder-83699 May 09 20:41:16.422093 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-26d6af12-9569-423b-bd8f-2de5895f7cca req-24661890-0f1c-4b51-ad85-95ff643be60f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033924 May 09 20:41:16.422893 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 518/1101] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:41:16.522366 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:16.530897 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e3cdfe57-9658-4abc-a7e2-fcaff9145d46 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.165520 May 09 20:41:16.531522 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 584/1102] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:16 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:17.549395 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:17.550104 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:17.556353 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:17.556794 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:17.557561 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:17.557995 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:17.694232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:17.701851 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ec0df958-7888-4e83-adfe-cd2cc23da7b7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1266 microversion: 2.1 time: 0.157172 May 09 20:41:17.702398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 519/1103] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:17 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:18.719525 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:18.720164 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:18.726431 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:18.726880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:18.727672 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:18.728107 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:18.856506 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:18.865589 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e510ed0b-0d97-4b80-a10c-853e89486ee7 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1452 microversion: 2.1 time: 0.150532 May 09 20:41:18.866157 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 585/1104] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:18 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:18.881495 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:41:18.882105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:41:18.888640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:18.889087 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:18.889846 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:18.890280 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:19.019340 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:41:19.026598 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ca3cfaeb-9b56-4660-8878-cc3674fefb89 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1452 microversion: 2.1 time: 0.148922 May 09 20:41:19.027153 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 520/1105] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:41:18 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:41:20.667962 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-5506c429-2128-43d6-bede-e2af33890a61 req-e2ada9f0-437c-48a6-9705-e63212620a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b41c8e0-e943-4df2-9c40-c6b3b9803cbe", "tag": "11da88c3-93de-46c0-8ab1-eea225f29510"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:41:20.676214 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-5506c429-2128-43d6-bede-e2af33890a61 req-e2ada9f0-437c-48a6-9705-e63212620a12 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:41:20.676661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-5506c429-2128-43d6-bede-e2af33890a61 req-e2ada9f0-437c-48a6-9705-e63212620a12 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:41:20.688216 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-5506c429-2128-43d6-bede-e2af33890a61 req-e2ada9f0-437c-48a6-9705-e63212620a12 service nova] Creating event network-changed:11da88c3-93de-46c0-8ab1-eea225f29510 for instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe on hv-cinder-83699 May 09 20:41:20.693225 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-5506c429-2128-43d6-bede-e2af33890a61 req-e2ada9f0-437c-48a6-9705-e63212620a12 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028873 May 09 20:41:20.693870 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 586/1106] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:42:04.192097 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:42:04.192648 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:42:04.196582 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-a036aff1-1a5a-4b46-8faf-99df2df30d02 req-e9f7cf83-cbb0-434b-a64c-8ae710b1d45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98279b96-77a7-48f1-aa77-551fff59ba77", "tag": "51968c87-09bb-44c3-835b-415f60941765"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:42:04.198495 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:04.198996 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:04.199793 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:04.200223 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:04.206016 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-a036aff1-1a5a-4b46-8faf-99df2df30d02 req-e9f7cf83-cbb0-434b-a64c-8ae710b1d45d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:04.206547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-a036aff1-1a5a-4b46-8faf-99df2df30d02 req-e9f7cf83-cbb0-434b-a64c-8ae710b1d45d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:04.217607 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-a036aff1-1a5a-4b46-8faf-99df2df30d02 req-e9f7cf83-cbb0-434b-a64c-8ae710b1d45d service nova] Creating event network-changed:51968c87-09bb-44c3-835b-415f60941765 for instance 98279b96-77a7-48f1-aa77-551fff59ba77 on hv-cinder-83699 May 09 20:42:04.223570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-a036aff1-1a5a-4b46-8faf-99df2df30d02 req-e9f7cf83-cbb0-434b-a64c-8ae710b1d45d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031953 May 09 20:42:04.224857 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 587/1107] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 20:42:04.227528 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:42:04.316838 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-217948e0-a70b-4060-9b9c-cbb867af5e1a tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "DELETE /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 204 len: 0 microversion: 2.1 time: 0.128116 May 09 20:42:04.317581 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 521/1108] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:42:04 2022] DELETE /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:42:04.326494 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:42:04.327210 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:42:04.337871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:04.338530 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:04.339910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:04.340355 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:04.476653 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:42:04.484040 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-050058da-a95f-4db5-818d-8d8842a97b57 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.161700 May 09 20:42:04.484604 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 588/1109] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:42:04 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:42:05.502117 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:42:05.502941 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:42:05.509154 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:05.509869 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:05.510634 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:05.511060 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:05.713021 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:42:05.721081 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-f3bafdcc-df54-4c1b-b22f-7aa366edde14 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1569 microversion: 2.1 time: 0.223330 May 09 20:42:05.721631 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 522/1110] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:42:05 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:42:06.541977 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-c56736bc-eafb-4f0f-9047-a56d05cf0528 req-0e54103f-7694-470f-a62e-03c75d8cd4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98279b96-77a7-48f1-aa77-551fff59ba77", "name": "network-vif-deleted", "tag": "51968c87-09bb-44c3-835b-415f60941765"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:42:06.551926 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c56736bc-eafb-4f0f-9047-a56d05cf0528 req-0e54103f-7694-470f-a62e-03c75d8cd4cd service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:06.552362 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c56736bc-eafb-4f0f-9047-a56d05cf0528 req-0e54103f-7694-470f-a62e-03c75d8cd4cd service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:06.564842 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-c56736bc-eafb-4f0f-9047-a56d05cf0528 req-0e54103f-7694-470f-a62e-03c75d8cd4cd service nova] Creating event network-vif-deleted:51968c87-09bb-44c3-835b-415f60941765 for instance 98279b96-77a7-48f1-aa77-551fff59ba77 on hv-cinder-83699 May 09 20:42:06.571207 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-c56736bc-eafb-4f0f-9047-a56d05cf0528 req-0e54103f-7694-470f-a62e-03c75d8cd4cd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 May 09 20:42:06.571814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 589/1111] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:42:06.738275 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:42:06.738888 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:42:06.745152 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:06.745602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:06.746363 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:06.746797 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:06.808676 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408358ce1ea44a1ad62c41ebadd841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e23dd64fa8645c3a4ced56a7c9c62df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:42:06.816928 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b3570aba-bc58-42b0-9e3d-39c5c29eefa2 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 200 len: 1218 microversion: 2.1 time: 0.082700 May 09 20:42:06.817500 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 523/1112] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:42:06 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:42:07.834932 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:42:07.835662 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] [instance: 98279b96-77a7-48f1-aa77-551fff59ba77] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:42:07.842137 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:07.842579 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:07.844089 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:42:07.844521 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:42:07.857083 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] HTTP exception thrown: Instance 98279b96-77a7-48f1-aa77-551fff59ba77 could not be found. May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Request method failure captured: May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 HTTP/1.1 May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXtYJIA0OKExgQ1NkhqgrdT8pD7YP3H2gL6B5HVkxDBx1_9UINT0_rEKAN21CcHhzhdZ6L1Uv0ambn0fB9UixYhB1LredYGrt_3yRhAAAgVkHWHs4JLrsW1LYrVguBm3JxN5F6ThsK8OqMzrFGHHnmCstGCqJE56Mzt6B5EsXP3bJ2c May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: 5e23dd64fa8645c3a4ced56a7c9c62df May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-TestShelveInstance-551635868 May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:42:07.858654 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e23dd64fa8645c3a4ced56a7c9c62df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5e23dd64fa8645c3a4ced56a7c9c62df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e23dd64fa8645c3a4ced56a7c9c62df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5e23dd64fa8645c3a4ced56a7c9c62df"}]}] May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-TestShelveInstance-551635868 May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: 5e23dd64fa8645c3a4ced56a7c9c62df May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-TestShelveInstance-551635868 May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-TestShelveInstance-551635868-project May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: a408358ce1ea44a1ad62c41ebadd841d May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-TestShelveInstance-551635868-project May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 98279b96-77a7-48f1-aa77-551fff59ba77 could not be found. May 09 20:42:07.860179 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '98279b96-77a7-48f1-aa77-551fff59ba77'} May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98279b96-77a7-48f1-aa77-551fff59ba77 could not be found. May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:42:07.861049 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98279b96-77a7-48f1-aa77-551fff59ba77 could not be found. May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98279b96-77a7-48f1-aa77-551fff59ba77 could not be found. May 09 20:42:07.862609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:42:07.864205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Returning 404 to user: Instance 98279b96-77a7-48f1-aa77-551fff59ba77 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:42:07.864205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-80298a12-ed68-46d2-adec-430ed62f81c5 tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77" status: 404 len: 111 microversion: 2.1 time: 0.029295 May 09 20:42:07.864205 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 590/1113] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:42:07 2022] GET /compute/v2.1/servers/98279b96-77a7-48f1-aa77-551fff59ba77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:42:08.020656 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-21634399-0c38-495c-ad6f-164d2b76b9cd tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] Calling method '.version_select at 0x7f62bcbb5700>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:42:08.038962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-21634399-0c38-495c-ad6f-164d2b76b9cd tempest-TestShelveInstance-551635868 tempest-TestShelveInstance-551635868-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-808844846" status: 202 len: 0 microversion: 2.1 time: 0.022436 May 09 20:42:08.039763 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 524/1114] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 20:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-808844846 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:43:00.731670 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:43:00.732250 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:43:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:43:05.324769 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:43:05.325223 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:43:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:43:34.697980 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:34.698501 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:34.704637 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:34.705083 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:34.705833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:34.706271 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:34.729956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Going to try to terminate instance {{(pid=116849) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:43:34.802726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-39b3d8ad-afaa-471d-a1e9-cc8da2c31a00 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 204 len: 0 microversion: 2.1 time: 0.109284 May 09 20:43:34.803414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 591/1115] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:43:34 2022] DELETE /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:43:34.810056 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1fec0344-b0dd-4254-b635-f881e23fdc93] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 20:43:34.814659 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:34.815259 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:34.821695 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:34.822125 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:34.822875 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:34.823300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:34.954948 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:34.962190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-85b72697-236a-45d9-ace7-0ccd9f784251 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1576 microversion: 2.1 time: 0.154070 May 09 20:43:34.962769 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 525/1116] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:34 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:35.980357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:35.981066 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:35.987902 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:35.988354 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:35.989129 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:35.989567 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:36.123334 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:36.131482 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-a0b67d5c-38e1-4a31-8d58-4baa69594088 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1576 microversion: 2.1 time: 0.155321 May 09 20:43:36.132037 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 592/1117] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:35 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:37.148099 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:37.148760 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:37.158660 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:37.159110 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:37.159918 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:37.160343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:37.179811 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] [1fec0344-b0dd-4254-b635-f881e23fdc93] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42124. May 09 20:43:37.251872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:37.263178 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-c660ba04-144b-48bf-b000-2936b072095e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 200 len: 1509 microversion: 2.1 time: 0.118871 May 09 20:43:37.264062 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 526/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:37 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 1509 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:37.376261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-6e2c65ef-26c6-4057-a4aa-b96785d30083 req-a7387abc-f15f-4216-83fb-8769ba9404c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41c8e0-e943-4df2-9c40-c6b3b9803cbe", "name": "network-vif-deleted", "tag": "11da88c3-93de-46c0-8ab1-eea225f29510"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:43:37.387208 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-6e2c65ef-26c6-4057-a4aa-b96785d30083 req-a7387abc-f15f-4216-83fb-8769ba9404c9 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:37.387656 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-6e2c65ef-26c6-4057-a4aa-b96785d30083 req-a7387abc-f15f-4216-83fb-8769ba9404c9 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:37.400530 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-6e2c65ef-26c6-4057-a4aa-b96785d30083 req-a7387abc-f15f-4216-83fb-8769ba9404c9 service nova] Creating event network-vif-deleted:11da88c3-93de-46c0-8ab1-eea225f29510 for instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe on hv-cinder-83699 May 09 20:43:37.407020 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-6e2c65ef-26c6-4057-a4aa-b96785d30083 req-a7387abc-f15f-4216-83fb-8769ba9404c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039397 May 09 20:43:37.408221 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 593/1119] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:43:38.286734 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:38.287357 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:38.293988 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:38.294442 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:38.295228 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:38.295694 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:38.310920 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] HTTP exception thrown: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Request method failure captured: May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe HTTP/1.1 May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXxCJBcXy8_R5iihQU9PZ9I4JPd0A03aVVzd7G1btVRh4MJOUWuiWFVVMNIvOtV7cnKjO_6TUJSLdBa1bimKG3dOFwQtKbmrxE7XmWxiYsU0gakagAIKiFbgpJ47I4fb4CSJk1fo_JG5II69-UUmwe7m7cZDipMGCgy3EgdKfnLpZd4 May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:43:38.312649 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ceeb72f15a944fcbbd9095bb3d553126"}]}] May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-TestVolumeBootPattern-1014827536 May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-TestVolumeBootPattern-1014827536-project May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 95791a44989743338f7177fd8a2e434e May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-TestVolumeBootPattern-1014827536-project May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:43:38.314424 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '5b41c8e0-e943-4df2-9c40-c6b3b9803cbe'} May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:43:38.315475 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:43:38.316861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:43:38.318090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Returning 404 to user: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:43:38.318090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-06b00aef-0cb0-4f24-9abd-12e53fbbbeb4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 404 len: 111 microversion: 2.1 time: 0.031525 May 09 20:43:38.323603 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 527/1120] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:38 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:43:38.417357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-662809192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1619461407", "security_groups": [{"name": "tempest-secgroup-smoke-615297796"}], "block_device_mapping_v2": [{"uuid": "025f2a38-9c7e-4ec0-8fd8-308f582e8b5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e2ea1299-c317-41b1-b2f7-701f12287a92"}]}} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:43:38.534307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.network.neutron [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] validate_networks() for [('e2ea1299-c317-41b1-b2f7-701f12287a92', None, None, None, None, None)] {{(pid=116849) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:43:38.987752 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Flavor limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:43:38.988177 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Image limits 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:43:38.988651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Flavor pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:43:38.989061 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Image pref 0:0:0 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:43:38.989500 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.virt.hardware [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:43:38.998095 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:38.998547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:38.999348 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:38.999814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:39.016086 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:43:39.019945 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.quota [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for user 95791a44989743338f7177fd8a2e434e and project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'instances', 'ram', 'cores'} {{(pid=116849) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:43:39.075687 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Going to run 1 instances... {{(pid=116849) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:43:39.077909 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='025f2a38-9c7e-4ec0-8fd8-308f582e8b5d',volume_size=None,volume_type=None)] {{(pid=116849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:43:39.201685 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-c482632d-7c56-4b49-9250-17b7027511fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788911 May 09 20:43:39.202313 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 594/1121] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:43:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 20:43:39.213096 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-13d781ac-76f5-48b7-8a57-94229699b6e3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:39.213713 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-13d781ac-76f5-48b7-8a57-94229699b6e3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:39.270224 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-13d781ac-76f5-48b7-8a57-94229699b6e3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:39.276673 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-13d781ac-76f5-48b7-8a57-94229699b6e3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1094 microversion: 2.1 time: 0.067487 May 09 20:43:39.277238 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 528/1122] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:39 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:40.294231 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:40.294859 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:40.302910 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:40.303354 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:40.304357 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:40.304956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:40.369167 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:40.377017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1282768e-1d0d-4710-aa71-809ecef91cf3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1210 microversion: 2.1 time: 0.086825 May 09 20:43:40.377570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 595/1123] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:40 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:41.394073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:41.394683 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:41.403703 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:41.404149 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:41.404916 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:41.405512 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:41.544350 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-da78dde8-d39a-43d3-ad0f-32345d61c75c req-c05d792e-c3ba-4c92-a6a3-a30e55219df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505af329-d4cc-45a6-b34b-0f1aa9427818", "tag": "b6d74186-b1d6-4231-8ff2-0020098e099a"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:43:41.561824 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-da78dde8-d39a-43d3-ad0f-32345d61c75c req-c05d792e-c3ba-4c92-a6a3-a30e55219df0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:41.563581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-da78dde8-d39a-43d3-ad0f-32345d61c75c req-c05d792e-c3ba-4c92-a6a3-a30e55219df0 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:41.588956 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-da78dde8-d39a-43d3-ad0f-32345d61c75c req-c05d792e-c3ba-4c92-a6a3-a30e55219df0 service nova] Creating event network-changed:b6d74186-b1d6-4231-8ff2-0020098e099a for instance 505af329-d4cc-45a6-b34b-0f1aa9427818 on hv-cinder-83699 May 09 20:43:41.594711 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-da78dde8-d39a-43d3-ad0f-32345d61c75c req-c05d792e-c3ba-4c92-a6a3-a30e55219df0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056218 May 09 20:43:41.595486 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 596/1124] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:43:41.642253 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:41.650075 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-02f4c458-e9f8-4f8f-ba57-83fdaea4a925 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.259810 May 09 20:43:41.650642 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 529/1125] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:41 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:42.667873 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:42.668533 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:42.675018 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:42.675497 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:42.676269 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:42.676715 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:42.813652 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:42.821581 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-b09d14fc-a01d-4486-a27f-2140456cdf11 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.158459 May 09 20:43:42.822457 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 597/1126] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:42 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:43.839632 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:43.840199 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:43.846812 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:43.847250 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:43.848033 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:43.848461 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:43.975858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:43.983291 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-3af37404-301f-4fc9-a7bf-80e2267c651f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.147593 May 09 20:43:43.984105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 530/1127] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:43 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:45.001489 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:45.002147 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:45.008621 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:45.009321 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:45.010085 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:45.010518 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:45.139689 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:45.147044 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-2b841969-95a0-49a1-a834-558ade99aaa0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.150353 May 09 20:43:45.147621 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 598/1128] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:44 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:46.164122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:46.164717 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:46.171200 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:46.171677 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:46.172598 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:46.173022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:46.300426 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:46.307651 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b0c75275-672c-4de7-a5b8-5d91728d6b5d tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.147338 May 09 20:43:46.308194 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 531/1129] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:46 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:47.324501 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:47.325088 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:47.332048 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:47.332487 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:47.333235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:47.333661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:47.463507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:47.471249 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-516b7b72-268a-436e-9700-84c49a3433d6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.150565 May 09 20:43:47.471836 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 599/1130] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:47 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:48.488748 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:48.489356 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:48.495601 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:48.496042 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:48.496841 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:48.497246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:48.629132 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:48.636616 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-885a2f29-3e63-4705-89c8-6e14f4922855 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.152465 May 09 20:43:48.637165 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 532/1131] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:48 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:49.654033 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:49.654650 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:49.661610 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:49.662057 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:49.662820 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:49.663252 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:49.793067 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:49.800232 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-e0217e21-f833-4116-bc9a-0782a05bdc61 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.150123 May 09 20:43:49.800782 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 600/1132] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:49 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:50.817308 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:50.817926 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:50.824385 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:50.824830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:50.825590 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:50.826017 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:50.954123 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:50.961375 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-deaa8017-ccb1-4b36-9b79-82c5e74397a4 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.148301 May 09 20:43:50.961947 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 533/1133] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:50 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:51.978691 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:51.979307 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:51.986414 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:51.986943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:51.987725 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:51.988159 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:52.115043 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:52.122298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1a3a7894-a049-472c-893f-21aa98a2e3a9 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.147529 May 09 20:43:52.122866 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 601/1134] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:51 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:53.140000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:53.141283 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:53.147440 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:53.147881 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:53.148833 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:53.149537 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:53.216055 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-ee550887-858a-4064-8bcd-d1faa1ea8353 req-31e44f50-3c12-412d-b51c-7f97c571f2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505af329-d4cc-45a6-b34b-0f1aa9427818", "name": "network-vif-plugged", "status": "completed", "tag": "b6d74186-b1d6-4231-8ff2-0020098e099a"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:43:53.224569 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-ee550887-858a-4064-8bcd-d1faa1ea8353 req-31e44f50-3c12-412d-b51c-7f97c571f2d8 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:53.225084 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-ee550887-858a-4064-8bcd-d1faa1ea8353 req-31e44f50-3c12-412d-b51c-7f97c571f2d8 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:53.236584 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-ee550887-858a-4064-8bcd-d1faa1ea8353 req-31e44f50-3c12-412d-b51c-7f97c571f2d8 service nova] Creating event network-vif-plugged:b6d74186-b1d6-4231-8ff2-0020098e099a for instance 505af329-d4cc-45a6-b34b-0f1aa9427818 on hv-cinder-83699 May 09 20:43:53.241771 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-ee550887-858a-4064-8bcd-d1faa1ea8353 req-31e44f50-3c12-412d-b51c-7f97c571f2d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148767 May 09 20:43:53.242368 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 534/1135] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:43:53.294017 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:53.302036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-76b8b2b2-c939-46d3-9614-f23688fd5b9a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.166065 May 09 20:43:53.302603 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 602/1136] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:53 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:54.319808 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:54.320517 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:54.326624 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:54.327069 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:54.327861 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:54.328593 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:54.472293 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:54.480992 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-8711168a-92bf-479b-b467-6a7154e91fc5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1265 microversion: 2.1 time: 0.165922 May 09 20:43:54.481552 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 535/1137] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:54 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:55.501377 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:55.501985 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:55.508245 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:55.508694 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:55.509693 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:55.510127 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:55.652460 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:55.660651 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-f4d3565b-9fde-4948-8062-63ef0134a5de tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1451 microversion: 2.1 time: 0.163769 May 09 20:43:55.661212 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 603/1138] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:55 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:55.677052 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:43:55.677680 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:43:55.683965 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:55.684412 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:55.685167 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:55.685603 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:55.818736 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:43:55.826154 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b11cd554-3ef6-4414-9d5f-b932f8c9f9ca tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1451 microversion: 2.1 time: 0.152897 May 09 20:43:55.826707 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 536/1139] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:43:55 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:43:57.396072 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-be93bddb-2a2b-4f0f-a42b-951b36d75f69 req-0eea99e2-0184-4e3c-838b-c9b19bae7f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505af329-d4cc-45a6-b34b-0f1aa9427818", "tag": "b6d74186-b1d6-4231-8ff2-0020098e099a"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:43:57.403918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-be93bddb-2a2b-4f0f-a42b-951b36d75f69 req-0eea99e2-0184-4e3c-838b-c9b19bae7f3f service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:43:57.404356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-be93bddb-2a2b-4f0f-a42b-951b36d75f69 req-0eea99e2-0184-4e3c-838b-c9b19bae7f3f service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:43:57.415702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-be93bddb-2a2b-4f0f-a42b-951b36d75f69 req-0eea99e2-0184-4e3c-838b-c9b19bae7f3f service nova] Creating event network-changed:b6d74186-b1d6-4231-8ff2-0020098e099a for instance 505af329-d4cc-45a6-b34b-0f1aa9427818 on hv-cinder-83699 May 09 20:43:57.421104 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-be93bddb-2a2b-4f0f-a42b-951b36d75f69 req-0eea99e2-0184-4e3c-838b-c9b19bae7f3f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028538 May 09 20:43:57.422340 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 604/1140] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:44:50.324310 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:44:50.324912 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:45:54.133232 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1286327136", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1619461407", "security_groups": [{"name": "tempest-secgroup-smoke-615297796"}], "block_device_mapping_v2": [{"uuid": "8412d57d-df58-4c1f-8e9e-f063765fac4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e2ea1299-c317-41b1-b2f7-701f12287a92"}]}} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:45:54.294531 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.network.neutron [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] validate_networks() for [('e2ea1299-c317-41b1-b2f7-701f12287a92', None, None, None, None, None)] {{(pid=116850) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 20:45:54.709342 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Flavor limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 20:45:54.709756 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Image limits 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 20:45:54.710216 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Flavor pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 20:45:54.710613 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Image pref 0:0:0 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 20:45:54.711019 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.virt.hardware [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 20:45:54.719359 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:45:54.720122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:45:54.720640 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:45:54.721064 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:45:54.737358 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 20:45:54.741166 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.quota [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Getting quotas for user 95791a44989743338f7177fd8a2e434e and project ceeb72f15a944fcbbd9095bb3d553126. Resources: {'instances', 'ram', 'cores'} {{(pid=116850) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 20:45:54.795542 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Going to run 1 instances... {{(pid=116850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 20:45:54.797634 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8412d57d-df58-4c1f-8e9e-f063765fac4e',volume_size=None,volume_type=None)] {{(pid=116850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 20:45:54.922293 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-28ae0e33-6688-4b60-926e-78dd74c00715 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793906 May 09 20:45:54.923439 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 537/1141] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 20:45:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 20:45:54.931472 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7788837-b447-48b0-81df-bbe8867479bd] AMQP server on 10.222.0.44:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 09 20:45:54.935743 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-324e64f3-09e0-40fa-bb39-91a9cb2b16c1 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:45:54.936435 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-324e64f3-09e0-40fa-bb39-91a9cb2b16c1 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:45:55.040036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-324e64f3-09e0-40fa-bb39-91a9cb2b16c1 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:45:55.048695 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-324e64f3-09e0-40fa-bb39-91a9cb2b16c1 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1095 microversion: 2.1 time: 0.118482 May 09 20:45:55.049553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 605/1142] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:45:54 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1095 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:45:56.067021 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-6d6c52aa-6fb0-4b54-9021-6a574b78172a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:45:56.067662 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-6d6c52aa-6fb0-4b54-9021-6a574b78172a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:45:56.119798 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-6d6c52aa-6fb0-4b54-9021-6a574b78172a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:45:56.127429 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-6d6c52aa-6fb0-4b54-9021-6a574b78172a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1095 microversion: 2.1 time: 0.065482 May 09 20:45:56.128311 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 538/1143] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:45:56 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:45:57.144835 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-5d252a85-0ea7-47e1-a67c-a09b440e15e5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:45:57.145449 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-5d252a85-0ea7-47e1-a67c-a09b440e15e5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:45:57.155885 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7788837-b447-48b0-81df-bbe8867479bd] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42312. May 09 20:45:57.208312 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-5d252a85-0ea7-47e1-a67c-a09b440e15e5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:45:57.214814 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-5d252a85-0ea7-47e1-a67c-a09b440e15e5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1095 microversion: 2.1 time: 0.074188 May 09 20:45:57.215368 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 606/1144] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:45:57 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:45:58.231738 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-22abfb04-c433-4873-82f9-901e0830a9fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:45:58.232383 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-22abfb04-c433-4873-82f9-901e0830a9fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:45:58.287146 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-22abfb04-c433-4873-82f9-901e0830a9fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:45:58.294470 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-22abfb04-c433-4873-82f9-901e0830a9fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1095 microversion: 2.1 time: 0.066639 May 09 20:45:58.295090 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 539/1145] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:45:58 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:45:59.312260 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:45:59.312876 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:45:59.320435 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:45:59.320880 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:45:59.321645 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:45:59.322369 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:45:59.385837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:45:59.393491 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-065c00f3-d0f4-4503-974e-c52ef415e332 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1145 microversion: 2.1 time: 0.085073 May 09 20:45:59.394302 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 607/1146] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:45:59 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:00.410962 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:00.412318 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:00.418674 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:00.419122 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:00.419919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:00.420351 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:00.660566 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:00.668474 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-143cfe76-2727-40e1-b43c-b66d9d5688c6 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.261471 May 09 20:46:00.669043 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 540/1147] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:00 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:01.340941 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-5f4b44a3-5ac8-4c1a-9b92-d03998aa09ac req-4ea1b7f6-693b-4b82-a654-7d48a08699da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911040b4-3ae4-4567-a2cf-fbd56e826b5b", "tag": "538745d3-f911-44db-bc6e-a7c75c730ad3"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:46:01.349915 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-5f4b44a3-5ac8-4c1a-9b92-d03998aa09ac req-4ea1b7f6-693b-4b82-a654-7d48a08699da service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:01.350648 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-5f4b44a3-5ac8-4c1a-9b92-d03998aa09ac req-4ea1b7f6-693b-4b82-a654-7d48a08699da service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:01.364560 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-5f4b44a3-5ac8-4c1a-9b92-d03998aa09ac req-4ea1b7f6-693b-4b82-a654-7d48a08699da service nova] Creating event network-changed:538745d3-f911-44db-bc6e-a7c75c730ad3 for instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b on hv-cinder-83699 May 09 20:46:01.368333 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR oslo.messaging._drivers.impl_rabbit [req-5f4b44a3-5ac8-4c1a-9b92-d03998aa09ac req-4ea1b7f6-693b-4b82-a654-7d48a08699da service nova] [96b4b0d8-30e5-487a-9a6c-d50c95bc5bc6] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 20:46:01.686390 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:01.687749 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:01.694138 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:01.694578 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:01.695343 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:01.695800 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:01.828609 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:01.836473 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-01a30ca6-6dd0-4606-b44e-6cbf76ebf22c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.153943 May 09 20:46:01.837025 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 541/1148] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:01 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:46:02.377550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [req-5f4b44a3-5ac8-4c1a-9b92-d03998aa09ac req-4ea1b7f6-693b-4b82-a654-7d48a08699da service nova] [96b4b0d8-30e5-487a-9a6c-d50c95bc5bc6] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42332. May 09 20:46:02.381702 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-5f4b44a3-5ac8-4c1a-9b92-d03998aa09ac req-4ea1b7f6-693b-4b82-a654-7d48a08699da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.116274 May 09 20:46:02.382406 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 608/1149] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:46:02.853779 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:02.854391 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:02.861277 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:02.861720 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:02.862489 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:02.862919 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:03.059943 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:03.067296 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b992d42f-a836-4ac3-8361-b4f148658660 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.217342 May 09 20:46:03.067878 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 542/1150] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:02 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:04.084547 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:04.085242 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:04.091327 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:04.091805 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:04.092554 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:04.092982 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:04.222000 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:04.229194 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-712d471d-c029-4500-8ab3-a7b0c6962a2b tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.149383 May 09 20:46:04.229749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 609/1151] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:04 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:05.245997 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:05.246645 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:05.253603 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:05.254053 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:05.254821 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:05.255256 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:05.381487 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:05.389038 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-ae067e5a-7897-438e-ad3b-3b635b5b7947 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.146918 May 09 20:46:05.389602 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 543/1152] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:05 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:46:06.405903 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:06.406520 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:06.413407 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:06.413855 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:06.414626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:06.415050 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:06.548531 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:06.555838 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-0284d4c2-ee77-4166-935e-06e5343b43e8 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.153799 May 09 20:46:06.556397 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 610/1153] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:06 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:46:07.573361 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:07.573969 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:07.580022 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:07.580463 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:07.581219 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:07.582151 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:07.709820 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:07.717005 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-0e5824b8-7f50-4e47-8d46-a4a657412126 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.147642 May 09 20:46:07.717551 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 544/1154] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:07 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:08.733797 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:08.734410 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:08.741397 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:08.741839 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:08.742597 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:08.743029 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:08.870988 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:08.879643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-26286802-2d17-4fc4-8091-7982a775c74e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.149651 May 09 20:46:08.880442 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 611/1155] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:08 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:09.897235 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:09.897842 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:09.904105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:09.904541 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:09.905295 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:09.905724 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:10.035635 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:10.042790 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4039099e-ebb0-4c5a-b72c-a3d2f0fbff50 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.149397 May 09 20:46:10.043340 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 545/1156] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:09 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:11.060864 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:11.061483 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:11.067894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:11.068339 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:11.069098 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:11.069531 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:11.200624 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:11.208451 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-52e3dddf-36c6-454c-8d82-319feb25fd04 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.151400 May 09 20:46:11.209012 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 612/1157] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:11 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:11.807183 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [req-4216a085-5cec-4197-ac39-39f5621705ee req-6abcd70c-f57f-4d9e-a07a-5a92b726ba4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911040b4-3ae4-4567-a2cf-fbd56e826b5b", "name": "network-vif-plugged", "status": "completed", "tag": "538745d3-f911-44db-bc6e-a7c75c730ad3"}]} {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:46:11.816570 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-4216a085-5cec-4197-ac39-39f5621705ee req-6abcd70c-f57f-4d9e-a07a-5a92b726ba4b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:11.817008 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [req-4216a085-5cec-4197-ac39-39f5621705ee req-6abcd70c-f57f-4d9e-a07a-5a92b726ba4b service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:11.827538 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.compute.server_external_events [req-4216a085-5cec-4197-ac39-39f5621705ee req-6abcd70c-f57f-4d9e-a07a-5a92b726ba4b service nova] Creating event network-vif-plugged:538745d3-f911-44db-bc6e-a7c75c730ad3 for instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b on hv-cinder-83699 May 09 20:46:11.833326 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [req-4216a085-5cec-4197-ac39-39f5621705ee req-6abcd70c-f57f-4d9e-a07a-5a92b726ba4b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036788 May 09 20:46:11.833844 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 546/1158] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:46:12.225638 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:12.226248 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:12.232541 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:12.232979 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:12.233726 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:12.234153 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:12.365064 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:12.372197 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-1d3852bd-5099-4cfa-a388-9a37842f559a tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.150399 May 09 20:46:12.372750 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 613/1159] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:12 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:13.390747 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:13.391600 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:13.397653 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:13.398092 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:13.398836 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:13.399263 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:13.528195 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:13.536055 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-b4acef7b-355d-4a20-93d7-e3621407da6e tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1266 microversion: 2.1 time: 0.149942 May 09 20:46:13.536604 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 547/1160] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:13 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:14.553570 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:14.554189 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:14.560530 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:14.560977 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:14.561732 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:14.562162 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:14.693349 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:14.700550 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-89a0520c-6511-4ba3-aa2e-696a26b31dcf tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1453 microversion: 2.1 time: 0.151445 May 09 20:46:14.701105 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 614/1161] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:14 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:46:14.716427 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:46:14.717041 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:46:14.724045 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:14.724486 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:14.725245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:14.725682 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:14.851815 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:46:14.859360 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-d4e5dc37-3cb2-4945-ac07-bf1147dee8aa tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1453 microversion: 2.1 time: 0.146731 May 09 20:46:14.860515 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 548/1162] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:46:14 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:46:16.708003 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-1229e989-5963-4578-a26f-25b4a8041d5b req-c7218935-aac6-4681-a6a4-15f45f29c206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911040b4-3ae4-4567-a2cf-fbd56e826b5b", "tag": "538745d3-f911-44db-bc6e-a7c75c730ad3"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:46:16.716230 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-1229e989-5963-4578-a26f-25b4a8041d5b req-c7218935-aac6-4681-a6a4-15f45f29c206 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:46:16.716746 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-1229e989-5963-4578-a26f-25b4a8041d5b req-c7218935-aac6-4681-a6a4-15f45f29c206 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:46:16.727248 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-1229e989-5963-4578-a26f-25b4a8041d5b req-c7218935-aac6-4681-a6a4-15f45f29c206 service nova] Creating event network-changed:538745d3-f911-44db-bc6e-a7c75c730ad3 for instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b on hv-cinder-83699 May 09 20:46:16.732643 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-1229e989-5963-4578-a26f-25b4a8041d5b req-c7218935-aac6-4681-a6a4-15f45f29c206 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028282 May 09 20:46:16.733599 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 615/1163] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:46:20.741450 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:46:20.742088 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:48:05.335457 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:48:05.336026 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:48:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:48:07.487570 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:07.488183 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:07.495849 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:07.496306 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:07.497245 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:07.497685 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:07.526266 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:48:07.570828 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-3b524ea3-db59-4cda-8194-bbc6f4dc8e19 req-5c45f866-3c3d-4744-bd25-03201b0da87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911040b4-3ae4-4567-a2cf-fbd56e826b5b", "tag": "538745d3-f911-44db-bc6e-a7c75c730ad3"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:48:07.579515 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-3b524ea3-db59-4cda-8194-bbc6f4dc8e19 req-5c45f866-3c3d-4744-bd25-03201b0da87c service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:07.580045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-3b524ea3-db59-4cda-8194-bbc6f4dc8e19 req-5c45f866-3c3d-4744-bd25-03201b0da87c service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:07.591820 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-3b524ea3-db59-4cda-8194-bbc6f4dc8e19 req-5c45f866-3c3d-4744-bd25-03201b0da87c service nova] Creating event network-changed:538745d3-f911-44db-bc6e-a7c75c730ad3 for instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b on hv-cinder-83699 May 09 20:48:07.597495 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-3b524ea3-db59-4cda-8194-bbc6f4dc8e19 req-5c45f866-3c3d-4744-bd25-03201b0da87c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112727 May 09 20:48:07.598480 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 616/1164] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:48:07.622352 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-7461d8c2-b532-4df7-b698-6c40728f5622 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "DELETE /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 204 len: 0 microversion: 2.1 time: 0.140529 May 09 20:48:07.623870 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 549/1165] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:48:07 2022] DELETE /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:48:07.633254 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:07.634552 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:07.640660 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:07.641235 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:07.642395 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:07.642829 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:07.781423 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:48:07.789731 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-56818b23-6efc-4312-8e89-24d9b5307177 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1578 microversion: 2.1 time: 0.160810 May 09 20:48:07.790310 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 617/1166] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:07 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 20:48:08.807832 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:08.808466 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:08.814810 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:08.815262 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:08.816065 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:08.816499 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:08.987518 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:48:08.994830 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-40a3ef4e-fbdf-4886-a856-5890ec8c1743 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1578 microversion: 2.1 time: 0.191506 May 09 20:48:08.995375 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 550/1167] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:08 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:48:09.927416 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-c552b137-4619-47cf-8aa8-80564af4182c req-81d13393-ada0-46f4-a6c0-6c8377c1f23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911040b4-3ae4-4567-a2cf-fbd56e826b5b", "name": "network-vif-deleted", "tag": "538745d3-f911-44db-bc6e-a7c75c730ad3"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:48:09.939408 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c552b137-4619-47cf-8aa8-80564af4182c req-81d13393-ada0-46f4-a6c0-6c8377c1f23d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:09.939871 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-c552b137-4619-47cf-8aa8-80564af4182c req-81d13393-ada0-46f4-a6c0-6c8377c1f23d service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:09.951930 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-c552b137-4619-47cf-8aa8-80564af4182c req-81d13393-ada0-46f4-a6c0-6c8377c1f23d service nova] Creating event network-vif-deleted:538745d3-f911-44db-bc6e-a7c75c730ad3 for instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b on hv-cinder-83699 May 09 20:48:09.956918 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-c552b137-4619-47cf-8aa8-80564af4182c req-81d13393-ada0-46f4-a6c0-6c8377c1f23d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033288 May 09 20:48:09.957626 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 618/1168] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:48:10.014284 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:10.014910 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:10.021253 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:10.021702 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:10.022465 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:10.022897 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:10.083080 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:48:10.090396 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e7310baa-0c63-44f8-8483-f22b194ad5b5 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 200 len: 1226 microversion: 2.1 time: 0.079998 May 09 20:48:10.090952 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 551/1169] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:10 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:48:10.332803 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:48:10.332999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:48:11.108699 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:11.109436 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 911040b4-3ae4-4567-a2cf-fbd56e826b5b] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:11.116630 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:11.117082 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:11.117848 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:11.118287 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:11.131718 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] HTTP exception thrown: Instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b could not be found. May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Request method failure captured: May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b HTTP/1.1 May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXxCJBcXy8_R5iihQU9PZ9I4JPd0A03aVVzd7G1btVRh4MJOUWuiWFVVMNIvOtV7cnKjO_6TUJSLdBa1bimKG3dOFwQtKbmrxE7XmWxiYsU0gakagAIKiFbgpJ47I4fb4CSJk1fo_JG5II69-UUmwe7m7cZDipMGCgy3EgdKfnLpZd4 May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:48:11.133298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ceeb72f15a944fcbbd9095bb3d553126"}]}] May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 95791a44989743338f7177fd8a2e434e May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b could not be found. May 09 20:48:11.135285 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '911040b4-3ae4-4567-a2cf-fbd56e826b5b'} May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b could not be found. May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:48:11.136356 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b could not be found. May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b could not be found. May 09 20:48:11.138203 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:11.139913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Returning 404 to user: Instance 911040b4-3ae4-4567-a2cf-fbd56e826b5b could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:48:11.139913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-3be8326e-3645-430e-9815-92d1f7ff7353 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b" status: 404 len: 111 microversion: 2.1 time: 0.030939 May 09 20:48:11.139913 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 619/1170] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:11 2022] GET /compute/v2.1/servers/911040b4-3ae4-4567-a2cf-fbd56e826b5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:48:14.490374 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-0626a06a-d04e-4136-9373-80588755a776 req-f9b55940-1a40-46b8-886e-5af29b064d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505af329-d4cc-45a6-b34b-0f1aa9427818", "tag": "b6d74186-b1d6-4231-8ff2-0020098e099a"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:48:14.497752 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:14.498250 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:14.498943 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0626a06a-d04e-4136-9373-80588755a776 req-f9b55940-1a40-46b8-886e-5af29b064d27 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:14.499419 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-0626a06a-d04e-4136-9373-80588755a776 req-f9b55940-1a40-46b8-886e-5af29b064d27 service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:14.505110 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:14.505971 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:14.507034 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:14.507698 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:14.511707 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-0626a06a-d04e-4136-9373-80588755a776 req-f9b55940-1a40-46b8-886e-5af29b064d27 service nova] Creating event network-changed:b6d74186-b1d6-4231-8ff2-0020098e099a for instance 505af329-d4cc-45a6-b34b-0f1aa9427818 on hv-cinder-83699 May 09 20:48:14.518734 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-0626a06a-d04e-4136-9373-80588755a776 req-f9b55940-1a40-46b8-886e-5af29b064d27 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032881 May 09 20:48:14.519574 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 620/1171] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:48:14.537333 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Going to try to terminate instance {{(pid=116850) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 20:48:14.637255 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-000bbd0a-abf2-4d04-8d83-03cba87da619 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "DELETE /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 204 len: 0 microversion: 2.1 time: 0.154835 May 09 20:48:14.638114 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 552/1172] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:48:14 2022] DELETE /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 20:48:14.647609 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:14.648305 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:14.654401 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:14.655079 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:14.656036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:14.657261 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:14.789317 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.policy [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116849) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:48:14.796732 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-fc152bd2-edb9-46e5-a84f-57f1fc70d0d0 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1575 microversion: 2.1 time: 0.154418 May 09 20:48:14.797298 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 621/1173] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:14 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:48:15.814620 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:15.815316 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:15.821669 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:15.822106 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:15.822858 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:15.823287 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:15.964349 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:48:15.971829 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-4d446414-a4e5-425f-95aa-e67dad58695c tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1575 microversion: 2.1 time: 0.161171 May 09 20:48:15.972399 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 553/1174] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:15 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:48:16.736073 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [req-2dc471c0-74b8-41ba-aa3a-9bad2990f683 req-dd3ce4ca-3c6c-4cc4-95c9-b030957f335c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505af329-d4cc-45a6-b34b-0f1aa9427818", "name": "network-vif-deleted", "tag": "b6d74186-b1d6-4231-8ff2-0020098e099a"}]} {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 20:48:16.748389 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-2dc471c0-74b8-41ba-aa3a-9bad2990f683 req-dd3ce4ca-3c6c-4cc4-95c9-b030957f335c service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:16.748806 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [req-2dc471c0-74b8-41ba-aa3a-9bad2990f683 req-dd3ce4ca-3c6c-4cc4-95c9-b030957f335c service nova] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:16.761458 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.compute.server_external_events [req-2dc471c0-74b8-41ba-aa3a-9bad2990f683 req-dd3ce4ca-3c6c-4cc4-95c9-b030957f335c service nova] Creating event network-vif-deleted:b6d74186-b1d6-4231-8ff2-0020098e099a for instance 505af329-d4cc-45a6-b34b-0f1aa9427818 on hv-cinder-83699 May 09 20:48:16.766837 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [req-2dc471c0-74b8-41ba-aa3a-9bad2990f683 req-dd3ce4ca-3c6c-4cc4-95c9-b030957f335c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034503 May 09 20:48:16.767561 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 622/1175] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 20:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 20:48:16.989398 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:16.990089 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:16.996246 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:16.996684 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:16.997445 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:16.997872 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:17.035437 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:17.035848 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:17.036496 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.objects.instance [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lazy-loading 'fault' on Instance uuid 505af329-d4cc-45a6-b34b-0f1aa9427818 {{(pid=116850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 20:48:17.082874 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.policy [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95791a44989743338f7177fd8a2e434e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb72f15a944fcbbd9095bb3d553126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116850) authorize /opt/stack/nova/nova/policy.py:199}} May 09 20:48:17.090523 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-14b28e59-9021-46a8-8ccb-b5667472122f tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 200 len: 1230 microversion: 2.1 time: 0.105530 May 09 20:48:17.091073 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 554/1176] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:16 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 20:48:18.108843 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:18.109553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 505af329-d4cc-45a6-b34b-0f1aa9427818] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:18.116553 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:18.117004 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:18.117768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:18.118202 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:18.131576 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] HTTP exception thrown: Instance 505af329-d4cc-45a6-b34b-0f1aa9427818 could not be found. May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Request method failure captured: May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 HTTP/1.1 May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXxCJBcXy8_R5iihQU9PZ9I4JPd0A03aVVzd7G1btVRh4MJOUWuiWFVVMNIvOtV7cnKjO_6TUJSLdBa1bimKG3dOFwQtKbmrxE7XmWxiYsU0gakagAIKiFbgpJ47I4fb4CSJk1fo_JG5II69-UUmwe7m7cZDipMGCgy3EgdKfnLpZd4 May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:48:18.133140 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ceeb72f15a944fcbbd9095bb3d553126"}]}] May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 95791a44989743338f7177fd8a2e434e May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 505af329-d4cc-45a6-b34b-0f1aa9427818 could not be found. May 09 20:48:18.135217 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '505af329-d4cc-45a6-b34b-0f1aa9427818'} May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505af329-d4cc-45a6-b34b-0f1aa9427818 could not be found. May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:48:18.136338 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505af329-d4cc-45a6-b34b-0f1aa9427818 could not be found. May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505af329-d4cc-45a6-b34b-0f1aa9427818 could not be found. May 09 20:48:18.138015 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.139620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Returning 404 to user: Instance 505af329-d4cc-45a6-b34b-0f1aa9427818 could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:48:18.139620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-da3ea8ba-453a-4a7b-bb83-5ed5143ae3fc tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818" status: 404 len: 111 microversion: 2.1 time: 0.030468 May 09 20:48:18.139620 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 623/1177] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:18 2022] GET /compute/v2.1/servers/505af329-d4cc-45a6-b34b-0f1aa9427818 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:48:18.576190 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:18.576781 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.compute.api [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116850) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:18.583867 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:18.584321 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:18.585086 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:18.585520 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG oslo_concurrency.lockutils [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:18.598879 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.wsgi [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] HTTP exception thrown: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Request method failure captured: May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: request: DELETE /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe HTTP/1.1 May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept: application/json May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Accept-Encoding: identity May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Connection: close May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Length: 0 May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Content-Type: application/json May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Host: 10.222.0.44 May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Openstack-System-Scope: None May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: User-Agent: python-urllib3/1.26.9 May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Auth-Token: gAAAAABieXxCJBcXy8_R5iihQU9PZ9I4JPd0A03aVVzd7G1btVRh4MJOUWuiWFVVMNIvOtV7cnKjO_6TUJSLdBa1bimKG3dOFwQtKbmrxE7XmWxiYsU0gakagAIKiFbgpJ47I4fb4CSJk1fo_JG5II69-UUmwe7m7cZDipMGCgy3EgdKfnLpZd4 May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Id: None May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Domain-Name: None May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Identity-Status: Confirmed May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Is-Admin-Project: True May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Id: default May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Domain-Name: Default May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Project-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Role: reader,member May 09 20:48:18.600558 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Roles: reader,member May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ceeb72f15a944fcbbd9095bb3d553126"}]}] May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Id: default May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Domain-Name: Default May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Id: 95791a44989743338f7177fd8a2e434e May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: X-User-Name: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: method: > May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: exception: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.602300 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: action_args: {'id': '5b41c8e0-e943-4df2-9c40-c6b3b9803cbe'} May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:48:18.603534 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.605366 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: ERROR nova.api.openstack.wsgi May 09 20:48:18.607192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Returning 404 to user: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. {{(pid=116850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:48:18.607192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-e39d043d-92ae-4921-b8c3-f752466c1bd3 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 404 len: 111 microversion: 2.1 time: 0.029692 May 09 20:48:18.607192 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 555/1178] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 20:48:18 2022] DELETE /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:48:18.610404 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '>' {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:18.611047 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.compute.api [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] [instance: 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe] Fetching instance by UUID {{(pid=116849) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 20:48:18.617840 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:18.618289 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:18.619045 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 20:48:18.619501 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG oslo_concurrency.lockutils [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Lock "226b11f8-5e53-483b-be5e-f910c39e1ec6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 20:48:18.635170 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.wsgi [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] HTTP exception thrown: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Request method failure captured: May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: request: GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe HTTP/1.1 May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept: application/json May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Accept-Encoding: identity May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Connection: close May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Length: 0 May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Content-Type: application/json May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Host: 10.222.0.44 May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Openstack-System-Scope: None May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: User-Agent: python-urllib3/1.26.9 May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Auth-Token: gAAAAABieXxCJBcXy8_R5iihQU9PZ9I4JPd0A03aVVzd7G1btVRh4MJOUWuiWFVVMNIvOtV7cnKjO_6TUJSLdBa1bimKG3dOFwQtKbmrxE7XmWxiYsU0gakagAIKiFbgpJ47I4fb4CSJk1fo_JG5II69-UUmwe7m7cZDipMGCgy3EgdKfnLpZd4 May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Id: None May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Domain-Name: None May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Identity-Status: Confirmed May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Is-Admin-Project: True May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Id: default May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Domain-Name: Default May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Project-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Role: reader,member May 09 20:48:18.636661 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Roles: reader,member May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ceeb72f15a944fcbbd9095bb3d553126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ceeb72f15a944fcbbd9095bb3d553126"}]}] May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Id: ceeb72f15a944fcbbd9095bb3d553126 May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1014827536 May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Id: default May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Domain-Name: Default May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Id: 95791a44989743338f7177fd8a2e434e May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: X-User-Name: tempest-TestVolumeBootPattern-1014827536-project May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: method: > May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: exception: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.638372 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: action_args: {'id': '5b41c8e0-e943-4df2-9c40-c6b3b9803cbe'} May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: {{(pid=116849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 20:48:18.639635 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. May 09 20:48:18.641622 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: ERROR nova.api.openstack.wsgi May 09 20:48:18.643749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: DEBUG nova.api.openstack.wsgi [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Returning 404 to user: Instance 5b41c8e0-e943-4df2-9c40-c6b3b9803cbe could not be found. {{(pid=116849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 20:48:18.643749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO nova.api.openstack.requestlog [None req-6c698dc9-2af3-4bc0-8ede-b4e7921ff906 tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe" status: 404 len: 111 microversion: 2.1 time: 0.031433 May 09 20:48:18.643749 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: [pid: 116849|app: 0|req: 624/1179] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 20:48:18 2022] GET /compute/v2.1/servers/5b41c8e0-e943-4df2-9c40-c6b3b9803cbe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 20:48:19.921105 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: DEBUG nova.api.openstack.wsgi [None req-fc278c8d-94b5-4d7a-bdee-9ae0cd44e1db tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] Calling method '.version_select at 0x7f62bcc37dc0>' {{(pid=116850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 20:48:19.945247 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO nova.api.openstack.requestlog [None req-fc278c8d-94b5-4d7a-bdee-9ae0cd44e1db tempest-TestVolumeBootPattern-1014827536 tempest-TestVolumeBootPattern-1014827536-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1619461407" status: 202 len: 0 microversion: 2.1 time: 0.028355 May 09 20:48:19.946015 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: [pid: 116850|app: 0|req: 556/1180] 10.222.0.44 () {58 vars in 1262 bytes} [Mon May 9 20:48:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1619461407 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 20:49:30.875036 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:49:30.875659 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:49:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:49:40.756768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:49:40.756768 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:49:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:51:25.343147 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:51:25.343824 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:51:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:51:28.745954 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:51:28.746531 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:51:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:51:30.342322 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:51:30.342999 dv-cinder-836996-15-iscsi devstack@n-api.service[116850]: Mon May 9 20:51:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:52:50.883664 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:52:50.884263 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:52:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:53:00.763507 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:53:00.764191 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:53:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 20:53:21.037894 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 20:53:21.038534 dv-cinder-836996-15-iscsi devstack@n-api.service[116849]: Mon May 9 20:53:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!